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ABSTRACT 
The problem of optimally regulating the position and velocity 
of a string of vehicles in steady-state motion on a highway, when 
both vehicles and controller are subjected to additive noise and 


feedback time delay, is considered. 


Two simpler problems are first treated : 1. regulation of 
a string of vehicles when random vehicle and transmission disturbances 
are present, and 2. regulation of a string of vehicles when random 
vehicle disturbances and transmission delays exist. In both these 
instances, the optimal controller is developed using the optimal 
control and estimation theory available in the literature, and its 
performance is evaluated by simulation on an IBM System/360 digital 
Computer. Optimal stochastic regulator performance is compared 
with that of the optimal deterministic controller subjected to 
noise and time delay; both, in turn, are compared with the per- 
formance of the optimal deterministic regulator where noise and time 
delay are absent. The importance of having exact knowledge of the 
amount of feedback delay on the design and performance of the designed 


optimal regulator is also examined. 


It is shown that, by proper overall system design, not only 
can vehicle power plant size and passenger discomfort be Significantly 
reduced, but, what is even more important, regulation as well can 


be enhanced. 
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CHAPTER ONE 
INTRODUCTION 
ABSTRACT 


A brief synopsis of past work on the automatic vehicle 
control problem is presented with the view to indicate some of 
the gaps which now exist in the theory. The scope of this thesis 


is described. 
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1.1 General 


An increasing awareness that a majority of problems en- 
countered in the highway transportation systems of the major cities 
in North America are, to a large extent, due to inadequate vehicle 
control has initiated an ever-intensifying effort on the part of 
many researchers to understand the dynamic characteristics of 
traffic flow and to develop more sophisticated techniques for 
control than are presently available. While schemes for complete 
automation of the highway system have been proposed, efforts have 
also been directed toward the development of schemes in which the 
role of the human driver is either made more effective or is 
completely de-emphasized. To achieve the former objective some 
have advocated the development of various driver aids intelligently 
selected to help overcome basic human deficiencies in the driving 
task [14, ia Others have suggested revolutionary automatic 
systems in which the need for the human driver is virtually eliminated 
[15]. More practical proposals have however expounded an evolutionary 
concept in which the driver aided system serves as the transitional 
step from present normal systems to the ultimate fully integrated 


automatic one [36]. 


The control schemes for the automatic control of a string of 


vehicles on a roadway have ranged from decentralized control schemes 
« Faved. The: mnwtben) Jeu wernt ty ma fAtsin hte ann Antaveinnd 


| Numbers in square brackets refer to articles in the bibliography. 
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in which each vehicle is directed by information obtained at the 
vehicle itself, to strongly centralized control schemes in which 
the vehicle is part of a larger information system, (i.e.) each 
vehicle is located and commanded from data available at the 

central traffic control [11]. Although the centralized system 
provides greater flexibility and greater overall system efficiency, 
it is however seriously hampered by the need for a vast 
communications grid and an enormous initial capital outlay. None- 
theless, increasing social demands and the needs of an economy 
based on continuous expansion seem to be making the development of 


such an automatic transportation system a real necessity. 


1.2 The steady-state vehicle regulator in automatic control 


The automatic control of a string of moving vehicles such as 
that depicted in figure 1.1 requires that complete control be 
exercised over the position and velocity of the individual vehicles 
in the string at all times. Examining the acceleration, velocity, and 
position of each vehicle of the string (or of the string itself 
when all the component vehicles are moving as a unit) in figure 1.2 
[11] for an ideal excursion between some origin and destination, 
shows that the transitional control actions required at the initial 
and terminal times are separated from each other by a steady-state 
condition of relatively long duration where the vehicle velocity is 


fixed. The control Jaw required to maintain this pre-determined 
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FOR EQUAL SEPARATION BETWEEN VEHICLES IN THE STEADY-STATE, 


Ak = A 
k=l 2,ceaN 





FIGURE 1.1: Three vehicles moving in a string. 


steady-state condition is thus an essential element of any automatic 
system. It has, consequently, been the subject of intensive research 


for the past ten years, including that reported in this thesis. 
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FIGURE 1.2: The acceleration, velocity, and position 
versus time of a given vehicle travelling 
between two points. 
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To derive the steady-state control various schemes have been 
proposed, with the spectrum of control theory used ranging from the 
classical frequency response methods to modern optimal control theory. 
Fenton et al [17], Fenton and Bender [7], give a clear indication of 
the use of classical theory in the design. From given steady-state 
performance specifications a linear mode controller is readily 
developed. A much more sophisticated and relatively recent approach 
to the solution of the problem involves the application of optimal 
control theory. The vastly increased versatility in system design 
that this new technique has made possible has allowed it to almost 
completely overshadow the classical one. Consequently, classical 


control techniques will not be considered at all in this present work. 


1.3 Optimal control theory and steady-state vehicle control 


The use of optimal control theory to regulate the position and 
velocity of each vehicle in a long string was first proposed by 
Athans and Levine [27] in eee" Given that A and v are the desired 
separation distance between adjacent vehicles in the string and the 
desired string velocity respectively, they showed that through a 
suitable choice of state variables and index of performance the 
control problem could be reduced to the standard linear regulator 


problem with quadratic cost [24, 5]. 


Q Appendix one gives a short summary of the procedure and should be 
consulted at this point as only the implications of this scheme 
are considered in this present work. 
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The structure of the resultant optimal closed loop control 
system is shown in figure Al-2. From knowledge of the position and 
velocity of every vehicle in the string the optimal control input 
needed to maintain the desired vehicle separation and string velocity 


is determined. 


Since the derived optimal control scheme requires every 
vehicle to have complete knowledge of the state of all other vehicles 
in the string continuously in time, deployment of an expensive and 
complex communications system is then a necessary prelude to its 
implementation [3]. This realization spawned intensive research into 
possible ways of alleviating the information processing problem without 
excessive degradation of system performance. What resulted from this 


was the development of the following two systems : 


1. a suboptimal control system, and 2. a sampled data system where 


only samples of the state variables are transmitted every T seconds. 


1.3.1 Suboptimal control 


A paper by Athans, Levine, and Levis [4] expounds the basic 
philosophy of the suboptimal design. It proposes that each string 
of vehicles be considered to be constructed from a set of interlaced 
vehicle substrings. Having obtained the optimal control for each 
substring, the suboptimal control for the vehicle string can then be 


built up by superposition. 


Some proposals have sought to divide a given vehicle string into 
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substrings of two or three vehicles each [37] where : a) the control 
for each vehicle in the string is determined only by the motion of 
the vehicle directly ahead, or b) the control for each vehicle is 
determined by the motion of the vehicle directly ahead and behind, 
respectively. Using a criterion proposed by R.L. Cosgriff [12], 
Peppard and Gourishankar [37] have found that a given vehicle string 
constructed from the three vehicle basic unit exhibits a greater 
degree of asymptotic stability than one constructed from the two 


vehicle bre: 


Unlike the optimal design, the suboptimal one requires each 
vehicle in a long string to only have information on the position 
and velocity of all other vehicles in the substring of which it is 
a part. Simulation results [4] moreover show that the suboptimal 


design gives regulator performance close to that of the optimal. 


Melzer and Kuo [31, 32], using the theory of generating 
functions, mathematically justify the philosophy of suboptimal design. 
For a finite string of vehicles, they found that the exact controllers 
for each vehicle in the string have the same structure as that for a 
typical vehicle in an infinite string. In fact, the individual 
vehicle in an infinite string is shown to so heavily weigh information 


from the first few adjacent vehicles that information from the 





Since the linear regulator is known to be locally stable [5] all 
systems under consideration are at least locally stable. 
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remaining vehicles can be entirely ignored without incurring any 


noticeable change in performance. 


1.3.2 Sampled data control 


The possibility of alleviating the communication problem by 
using a sampled data analogue of the continuous controller has been 
studied extensively by various researchers [28, 29]. Levis [28] 
discusses its desirability from both an economic and technical 


viewpoint. 


Athans and Levis [30] derived the sampled data controller and 
studied the dependence of regulator performance upon the length of 
the sampling interval. Having postulated a continuous time dynamical 
system with quadratic cost, they introduce sampling by constraining 
the control to remain constant over a specified length of time (the 
sampling interval). Forcing changes in the control to occur only 
at the sampling instants then allows them to transform the problem 
to an equivalent discrete time one. The discrete minimum principle 


[25] is then applied. 


The sampled data system is shown to exhibit two modes of 
behaviour depending upon the closed-loop eigenvalues obtained Eeishs 
In one mode, the behaviour of the regulator is similar to that of 
the optimal continuous system, whereas performance in the other mode 


is similar to that of an overdamped system. 
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Levis [28] develops a computer algorithm which allows the 
designer to determine the optimal control of a linear sampled data 
system with quadratic cost without the least knowledge of optimal 


control theory. 


That the sampled data system can drastically cut communications 
requirements without great loss in regulator performance is adequately 
shown by Athans and Levis [30]. Choosing a sampling interval one 
and one half times the dominant time constant of the continuous open- 
loop system, they show that the optimal cost is only increased by 


Wee 
1.4 Need for further research 


In most of the work done to date the vehicle regulator problem 
has almost invariably been studied under idealized conditions where 
no system noise and no time delay in the feedback path exist. The 
plant dynamics and all state variables are assumed to be known exactly 
while all transmission and computation delays are excluded from 
consideration. It is needless to point out that this ideal model 
does not accurately portray the interactions between vehicles and 
surroundings in any physical system. The optimal regulator for the 
ideal system could in fact be far from optimal under the non-ideal 
conditions existent in the physical world. In the development of an 
automatic controller for highway vehicles then, a more realistic 


model must be proposed that will allow an optimal controller to be 
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designed whose performance in the real world will also be optimal, 


or as close to the optimal as possible. 
1.4.1 Effects of random disturbances 


Random vehicle disturbances induced by external sources result 
in a random deviation of the traffic queue from the equilibrium 
condition [40]. The raisons - d'etre of the optimal automatic 
system, namely larger system capacity and greater passenger safety, 
however require that these random deviations from equilibrium be 
minimized as much as possible by surat designing the optimal controller, 
if they are to be even remotely attained. From an economic viewpoint 
Rocca [40] moreover points out that an increase in velocity and 
acceleration disturbances results in increased power being dissipated 
by the vehicles and increased passenger discomfort and vehicle wear, 


respectively.” 


Vehicle dynamics have generally been formulated from the 
straightforward application of Newton's laws of motion where al] 
external vehicle disturbances such as wind and road conditions have 
been ignored. No lengthy elaboration is thus required to show that 
the fidelity with which the ideal model dynamics represent the physical 


system is far from satisfactory. 





Since the power level is proportional to the product of thrust and 
speed, we have that 


d(power level) ao thrust + d(speed) t+d(thrust) - speed, 


where d(-) denotes the operation of taking the total derivative. 
Because of the high speeds at which the automatic vehicles are expected 
to operate, these considerations are thus not altogether negligible. 
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If for the moment we consider the dynamics of the car-fol lowing 
problem to be known exactly, and if furthermore we disregard al] 
external vehicle disturbances, ideal conditions still do not exist. 
Random vehicle disturbances still occur due to the existence of 
noise sources in the vehicle control system itself. The state 
measurement device,” the transmission system, and the controller are 
all sources of random errors. Even though they may not be of large 
magnitude, these disturbances affect each vehicle in a controlled 
string. Relatively large random disturbances can also originate in 
a particular vehicle of the string. The queue response to such 
disturbances is determined entirely by the closed loop characteristics 


of the vehicle controller [40]. 


An area of research where several aspects need further invest- 


igation can be described as follows : 


Given a vehicle string subjected to external disturbances, and 
given that random errors do occur in the measurement of variables and 
in the transmission of information about the position and velocity 
of each vehicle, then how can an optimal controller be designed and 
how does this controller perform compared with that for an ideal system 


(under similar simulated real world conditions)? 





3 If a sampled data system were being considered quantization errors 
in the measurement of velocity and headway could also be included 
here. 
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The digital computer control of a string of moving vehicles 
when random errors occur in the information exchange between vehicles 
and central computer has been studied by Anderson and Powner [1]. 
However, their work mainly consists of a qualitative analysis of 
observed results. (The definition of some appropriate measure of 
vehicle performance could thus be quite helpful here in determining 
the extent to vehicle performance can be improved.) They fail to 
consider vehicle response when the noise statistics are not accurately 
known. Nor have they considered the case where state measurement 


and control are not coincident in time. 


Rocca [40] considers the problem of regulating a string of 
moving vehicles when vehicle disturbances occur as a result of 
environmental factors and system anomalies. He does however approach 
the problem from a classical point of view which does not yield the 
same kind of answers which can be expected from an optimal control 


formulation of the problem.© 


His analysis of vehicle disturbances 
and their sources will nevertheless be of great help and of practical 


use in the formulation of the optimal control problem. 


1.4.2 Effects of feedback time delays 


Another area of investigation where some problems require effort 


is related to time delays in the system. Careful examination shows 


eo ES 


2 This paper was published the year preceding the introduction in 


the literature of optimal control theory to the solution of the 
problem. 
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13 
that there exists a time delay in the feedback loop of the vehicle 
regulator for two reasons : 1. there is a transmission delay in 
sending and processing information on vehicle states from one 
vehicle to another, and 2. there is a finite computation time re- 
quired to calculate the optimal control from a given set of state 
variables. Though at first glance these time delays do not appear 
to be significant enough to noticeably affect regulator performance, 
they could however be of significance in determining the maximum 
number of vehicles which a central processing system can handle with 
safety at one time. If a controller capable of reducing the effects 
of time delays on vehicle performance could be designed, then the 
versatility and ultimate capacity of the system could be increased, 


at least in theory (other things being equal). 


To the best knowledge of the author, few papers exist which 
deal with the effects of time delays on the performance of vehicle 
strings. Whatever pertinent references were found have generally treated 
the problem of studying vehicle behaviour when a time delay is 
introduced into the feedback loop of a system designed on the 
assumption that no time delay exists [37]. While this approach does 
serve to give a rough estimate of the severity with which feedback 
delays affect regulator performance, there is a need for more refined 


techniques in the solution of the problem. 


The forementioned approach does serve to further understanding 


of vehicle regulator problems, however, the system designed in that 
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way is not the optimal one when the time delay is present. Hence, 
it fails to give a clear indication of how well the optimal regulator 


can perform in the presence of feedback delays. 


1.5 Scope of this thesis 


The aim of the work reported in this thesis was to examine the 
effects of both random disturbances and feedback time delays on the 
design and performance of an optimal steady-state controller for 
vehicle strings. Digital computer simulations of the designed 
regulators were done on the IBM System 360 Continuous System Modeling 
Program (S/360 CSMP) followed by a comparison of the relative 
performance of each. The IBM User's Manual [20] describes S/360 
CSMP as a "problem oriented program designed to facilitate the 
digital simulation of continuous processes on large digital machines”. 
In practice some type of sampled data scheme will most likely be 
used such as that described by Athans and Levis [30]. A continuous 
formulation was however convenient here and, as noted earlier, when 
the sampled data system is operating properly its performance is 


similar to that of the optimal continuous system. 


A brief description of the format employed in reporting this 


work may now be in order. 


Chapters two and three each deal with a portion of the overal] 
problem of securing the optimal vehicle control in the presence of 
both noise and time delay. Chapter four, on the other hand, welds 
together the results of the preceding two chapters and examines the 


total problem as initially laid down. Chapter five makes some 
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15 
concluding remarks based on the work reported in the preceding 
four chapters and gives some suggestions for future research 


possibilities. 


In appendix one an attempt is made to give the reader a short 
and basic introduction to optimal regulator theory as applied to the 
car following problem. Reference is made to Athans and Levine's 
original work on the derivation of a deterministic model and its 


adaption to solution using optimal control theory. 


Appendix two and appendix three are provided as a short review 
of theory employed in the body of the thesis; the certainty equivalence 
property of optimal control, and the derivation of the steady-state 


Kalman filter, respectively. 


Appendix four and appendix five serve to give the reader some 
understanding of the workings of the IBM System/360 CSMP program 
and of a few of the problems which arose in the course of simulating 


the models described in this thesis. 






ar 
pntbsssig oft nt batrogay stow arly rs 
dowssesy atusut +0T snotfespowe amaz eae bing prion 





tvod2 6 vabse, ont svip of Ssbem 27 Fe ad ng 30 iam 
edd oF batlags 26 Yiosnt yoreluper reiittdo ot for tauboxtnt otesd bas | 
2'gnived bie ensdtA ot sbem et gonavetsh  \meidova-patwol for 16 

ett bone febom aitetntmiassb 6 to nota syviieb; ot ho: Atow Tentpino 
roots fortes femitgo pritev fotsuloe oF noteqehs 


wotvey dyodz 6 26 bebivoyq sys sexdt Xtbnsags bas yaw xtbneqgh ~ 

sonelsvrups vinisdaeo odd :2taadt adt %O Ybed sid mt Heyoliqna ysoant to 

ajst2-ybsste ant to notisvtveb edd ba » forsned fanthqo to. ytisqorq | 7 
uevisosdest vad THF nemied 





8 tm 


gnoz vobpoy ont svip of avyse svi? xibasags bas ot xtbnsqaa _ 
mexpoyd os Odt\maseye MST oat to apnt drow sn?’ “Fo pntbiiedentebau 
onftsfumte to sarued eid nt 92076 ott mardorg aay Yo wor 6 Yo ba . 
zheanty ates nt badiraz9b efabom att 


an a: ~ 





seth 
YS Ge OF | _ RY | : nae . 





16 


CHAPTER TWO 


STEADY-STATE OPTIMAL CONTROL OF A STRING OF 
VEHICLES SUBJECT TO RANDOM DISTURBANCES 


ABSTRACT 


This chapter begins with the derivation of a stochastic model 
for a vehicle string subjected to various random disturbances. 
An optimal feedback system based on Kalman filtering and linear 
regulator theory is developed using results available in the 
literature. The various disturbances which affect vehicle per- 
formance are discussed as well as their amenability to representation 
by the derived stochastic model. An investigation of the random 
generator used to model the physical disturbances is also carried 
out to see how well the simulated random disturbances fulfill the 
requirements of the theory used. A quantitative measure of re- 
gulator performance is developed to permit a comparison of the per- 
formance of the optimal and the non-optimal stochastic regulator 
with that of the optimal noiseless regulator. The optimal system 
is simulated using the IBM System/360 CSMP program. A general 
discussion of observed results and their implications closes the 


chapter. 
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2.1 A stochastic model for a vehicle string 


The state space representation of a three vehicle string in 
longitudinal steady-state motion is given in appendix one. The 


equations (Al-3a) and (Al-3b) are repeated here for convenience. 


X(t) = A x(t) + Buj(t) 3 x(ty) = x, (2-1a) 


Ga (ty) (2-1b) 


K 
— 
ct 
wa 
iT} 


where x(t) (the state vector) ery, u, (t) (the control vector) 
a y(t) (the measured output vector) eR” and ; A, B, C are 
nxn, nx m, and rx n matrices, respectively. The (real) vector 
space dimensions n, m, and r are related to the number of vehicles 


in the controlled string, N, by 


In order to develop a more accurate model for the vehicle 
string, three additional factors will be included : 1. transmission 
errors in communicating information to and from the controlled 
vehicles, 2. controller noise, and 3. external disturbances such 


as wind and road conditions. 
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Controller noise w,(t) and transmission noise w,(t) (from 
the system control centre to the vehicles) can be easily introduced 
into the model by assuming that the output of the controller, u,(t), 
is the sum of a deterministic signal, u(t), and the two random noise 


terms. In other words, ~ 
u(t) = u(t) + wy (t) + wo(t). (2-1c) 
Random external vehicle disturbances due to wind and road 
conditions can now be included by adding one further term, w(t). 
Equation (2-la) becomes 
x(t) = Ax(t) + B u(t) + Blw,(t) + wo(t)] + wa(t). (2-14) 
Defining an equivalent noise term w(t) such that 
w(t) = BEwy(t) + wo(t)] + w(t) (2-1e) 


then simplifies equation (2-ld) to 


X(t) = A x(t) +B u(t) + w(t) 5 x(tg) = X - (2-2a) 


In a similar manner, the noise in the measurement of x(t) and 
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the noise introduced in the transmission of information about the 


States from the vehicles to the controller are taken into account 


by modifying equation (2-1b) as follows : 


Let v(t) be the measurement noise and let vo(t) 


the transmission noise described above. Also, let 


v(t) = vj (t) + vo(t) 


Rewrite equation (2-1b) as 


be 


(2-2b) 


(2-2c) 


The resultant stochastic system will then be taken to be 


described by the state-output equation 


X(t) = Ax(t) + Bu(t) + w(t) 3 x(t 


i] 
i) 
~< 
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co 
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y(t) 


(2-3a) 


(2-3b) 


where, for conveneince, {w(t)} and{v(t)} are henceforth referred to 


as the plant and measurement noise, respectively. 


The deterministic system described by the pairs (A,B) and 


(A,C)is assumed completely controllable and observable (appendix 
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three discusses the importance of these assumptions). The noise 
processes {w(t)} , {v(t)} are assumed to be stationary independent 


white Gaussian with autocovariances [23] 


cov [w(t), w' (t)] = W é(t-t) ; W> 0 (2-4a) 
cov, (v(t) evietz)] = V¥ 6(t-7) 3 V > 0 (2-4b) 
and 

E {w(t)} = E {v(t)} =0 (2-4c) 


The foregoing assumptions are required to enable a solution of the 
problem with the available theory. Section 2.5 examines actual 
vehicle disturbances to see how valid these assumptions are and to 


see how any inconsistencies affect the model. 


2.2 The deterministic regulator 


Considering the optimal deterministic (no noise) regulator 
derived in appendix one and presented in figure Al.2 in light of the 


discussion of section 2.1, it can be seen that a more realistic 
representation of the operation of that regulator under actual operating 


conditions is given in figure 2.1. 


pnitsveqo [autos yabnu sotsfupsy tang to noite aqo ont % 


OS 














_ 
- q i 
(enutszamuzes geand Yo Ssansivoqnit add 252a2ud2 itt 


“—_ 


sbat vasndttet2 od of bomezs 516 ((F)N? TS) — 0'tC 


INeoNS qs 
| eS] esonsfwsvooosis ATW soteame sti. 
i vs ry nd 7 


aaron ont . 


: ~~ 
aft to nattulo2 6 sfdsne ot bovirupsy 975 enoitqmiees pnfopsto? siT 
[suitos zontmexs 2.8 nottos2 .yvoort afdel taversns natw mofdorg — 


sim) + 
16 2notsiamyers seodt brlev wod s9e of zannbdysetb Siamay 
7 P P = - 
.fobom ont Jootts eatonederenoonl Yas Won See 
| | o 
por aitetntins tab: a Ss 7 


“os Tues 


} 
yo3etupsy (s2eton on) oft2ininnsteb remttqo silt: paivebienod > - 
eft to tdpif nf $.TA siuptt nf betns2siq bas Sno nifbrieqgs wnt ‘boy +b 


7 
ottetissy svom 6 fadt nese od nso Hits t. feniet vahey ies wai : 
wa ¥ & 


aie pe 


> rs 


navip we ots hbmoo 





Prot: ae 


ae 





FIGURE 2.1: The deterministic regulator 
corrupted by plant and measurement 
noise (NO SR). 
The presence of the noise sources {w(t)} and {v(t)} is emphasized 
there. That controller, for reasons to be considered in section 
2.3, iS now no longer the optimal one, however, and some other design 


must be proposed. In subsequent discussions this regulator wil] 


also be referred to as the NOSR (the non-optimal stochastic regulator). 


2.3 A cost functional for the stochastic model 

Because of the stochastic nature of the model developed in 
section 2.1, it makes no practical sense here to propose an index 
of performance, J(u), such as given by (Al-4). The state variables 
x(t) and the controls u(t) are both random vectors whereupon the cost 
function J(u) is a random variable. As a result, the optimal 


control u*(t) for some specified sample function of each of the 
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random vectors w(t) and v(t) may not be optimal for some other 
sample function of each. A logical choice of performance index 
in this stochastic case is rather the expected value of the random 


variable J(u), defined by 


Jp(u) = Ed¢lim + iV CO Sc SOT TD ale (2-5) 


Where R > 0, Q > O, and E{-}is the expectation taken over al] 
underlying random quantities. The term 1/T is inserted to keep the 
cost Jp(u) finite as the terminal time T approaches infinity [42]. 
In a sense (2-5) seeks to optimize the average performance of the 


vehicle system (2-3). 


2.4 The optimal stochastic regulator 


The optimal control problem requires that, from the set of 
admissable controls u(t), the optimal control u*(t) be found which 


will minimize the cost (2-5 subject to the dynamic constraints (2-3). 


2.4.1 Optimal control and the separation property 


Due to the presence of the control vector u(t) in (2-5), 
minimization of Je(u) requires that the effects of the stochastic 
disturbances on the feedback controls first be known. In appendix 


two it is shown that given 
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as the measured output vector, it is generally not possible to 
deduce the stochastic effects of the controls u(t) since the system 
State vector x(t) is not known. In order to circumvent this 
difficulty, it is also shown there that one can rather find the 
conditional stochastic effects of future control actions by treating 
the conditional density of the state x(t) as one would the actual 
State x(t). The Gaussian assumptions of section 2.1 then allows 
parametrization of the conditional density (which is of infinite 
dimension) by its conditional mean and covariance, each in a finite 
dimensional space [42]. If the covariance is independent of control 
and observation (see appendix two), then only controls of the form 


A 


u(t) = o(t, x (t)) for some 9 (-,-) (2-6) 


need be sought. The process being controlled is now the conditional 


mean process x(t). 


A rather obvious conclusion that can be drawn from an exam- 
ination of equation (2-6) is that the estimation problem and the 
control problem can be separated if the state estimator x(t) can 
be designed independently of any control considerations. Under this 
condition, the certainty equivalence property, discussed in appendix 
two and applied in equation (2-6), is often termed the separation 


property.’ 


eorsa rigorous proof see Tse [42], Kleinman [23], or Wonham [44]. 
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In the case where the separation property holds, the optimal 
control for the cost function (2-5) can be obtained in two steps : 
1. find the conditional mean estimate x(t) Of <thercurrent state, 
and 2. find the optimal feedback gains, L*, treating the conditional 
mean estimate as the true state of the system. Since the optimal 


feedback gains are found by assuming that the conditional mean 


estimate x(t) 1Sthe true *stateror the System, it iS obvious that, 
given the cost function (2-5), the optimal feedback gain matrix, L*, 
of the stochastic system is identical to that of the deterministic 


One of appendix Peas Hence 
u*(t) = -R-'B'K x(t) = -L* x(t) (an) 


It should be noted, however, that the separation property is 
rather a coincidental result of the theory (i.e. that the estimator 
x(t) can be designed independently of the control u(t)) and does 
not hold in the general case of nonlinear systems where control and 


estimation are interrelated. 


BNote that the difference in a factor of 1/2 between equations 


(2-5) and (Al-4) is of no importance since only the relative 
value of the weighting matrices Q and R determine the final 
answer obtained. 
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2.4.2 The Kalman filter in the control loop 


For the constant system described by equations (2-3), it is 
shown in appendix three that, invoking the assumptions of complete 
controllability and observability as well as the Stationarity of 
the disturbance noises, the steady-state Kalman filter (modified 
to include the effects of the deterministic input u(t))can be derived. 
This steady-state Kalman filter, given by 


] 


x (t) = Ax(t) + xc'v"! (y(t)-cx(t)) + Bu(t) (2-8) 


where Z (the conditional covariance of the state) is the unique 
solution to the algebraic Riccati equation 

Ae EN e720 VigCle + iN-O8% Sa 5.0 pots (2-9) 
is the best linear estimator of the state of the completely 
controllable and completely observable constant system (2-3),in 
terms of the output process y(-) over the time interval (-~,t). 
Design of the Kalman filter rests solely in the choice of me (the 
steady-state conditional covariance of the state); which is done 
independently of any control considerations. Recalling the discussion 
in subsection 2.4.1 on the separation property, it is then evident 
that in this instance the problem of control and estimation are 


separable. 


‘ 
ah 







4 ao. ae 


goo! fovgnos sAt at nett nsmlet sess 


5} 47 (8-8) enotteups va eakiezet ned ey2 snub ana 
atsiqmos to enotsamuezs add pnttovat . tend outdid x breads 


L) i ae 
















to Wi iveflottes2 sft 26 Tlow 26 yiil tdevysedo bile Nd 


{ 


baittbon) ytlt? nsmlsy stste-ybsst2 ot _2a2or tes 


» 


bavivab od fea((s)utuqnt sisetnineseb sit to esastte! ofits 


yd nevip 19a FF Set 





‘hh ine 
(9-8) (f)ua + ((3)x0- (ty)! V9.3 + (3)xA = (4) x. {} 
i 


ims 
“ i 





sipinu sat 2fF (ot6te ant to 9nnstievo> [snotytbaos att) 3 


nottsups ttsaootd atsidepis snd oF” 


hy 
ij 


y; i  « bel "4 fey i : 
(@-S) atty D 4 oc, g)DaNrt 8g ‘5 ee i 


a ai : 










yistefamoo sf to ates? Sat to. votenideommant § $28 

nt. {€-S) mateye tneF2102 aldevisedo uistaranoa | Sa en 
+, »-), fevisint smtt ads avo Owe 229907 

” i to goto i ni uisfoe: rer 


= ia 
ono cao fn al: +; she 3 3 to sone 16 a a. : :) c i 
m f patie 4 eo: As 


{ ; nitine ‘ 
Pe 
son : ve bea 


i cw uo. ee 


it, : 
a, oe 
: vn, a 7 va is xf 


ie 


26 


The optimal controller in the presence of driving noise and 
measurement noise thus requires: 1. the Kalman filter estimate of 
the system states, and 2. the optimal feedback gains (obtained 
as in the deterministic case of appendix one) to operate on the 
State estimate to give the optimal system control u*(t). The 
resulting optimal stochastic regulator (also to be referred to 


as the OSR) is shown in figure 2.2. 


w(t) v(t) 





L STEADY - STATE KALMAN FILTER | 


FIGURE 2.2: The optimal stochastic 
regulator (OSR).9 


9 To permit the steady-state Kalman filter of equation (2-12) to be 
drawn in the block diagram form shown in the figure, recall that 
VCE) B= Gx (CG) ee 
Rearranging (2-12), after substituting for y(t), gives 


x (t)=[A-2,C'V7!c}x(t)+Bu(t)+2,c'v" y(t) 
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24 
2.5 Driving and measurement noise covariance matrices 


Design of the steady-state Kalman filter requires specification 


of the driving noise and measurement noise covariances as 


E {w(t) w'(r)} 
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Actually, noise is never exactly wnite and, in many cases, 
the assumption that the noise is white is quite inappropriate. 
Frequently, however, the Gaussian noise added on to a desired signal 
has a relatively flat spectrum with components that extend well 
beyond those that are significant in the signal itself. In these 


cases the assumption that the noise is Gaussian and white is quite valid. 


To judge the reasonableness of such an assumption in the 
vehicle control problem under consideration here, a brief examination 


of the various vehicle disturbances is in order. 


Controller noise {W(t)} is essentially due to the thermal 
noise of the controller components (which is proportional to the 
temperature) and the noise associated with the vehicle state measure- 
ment device. Assuming that the temperature and vehicle velocity 
remain relatively constant then this noise source is essentially 


stationary and the white noise assumption holds fairly well [40], 
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forte In any modern communication system however, the signal output 
of the receiver is generally well above the background noise of the 
system so that {w,(t)} can be ignored for all practical purposes. 
Nevertheless, occasions do arise when large electrical disturbances 
(both natural and man-made) do cause a significant deterioration of 
the received signal. Since the pass-band of the optimal regulator 

is rather narrow, these relatively large disturbances, {Wo (t) } and 
{v(t)} , can generally be accomodated as white noise for purposes 

of this model. Moreover, it would seem that they may be approximated 
as wide-sense stationary processes which, as a result of the Gaussian 
assumption, imply strict sense stationarity. Of course these latter 
statements on {w,(t) }and {v(t)} are not strictly justifiable. The 
wind and road disturbances {w.(t) }will also be taken as stationary 
white Gaussian noises even though this assumption is somewhat less 


tenable than it is in the case of {wo (t) } and {v(t)} . 


Further, assuming for purposes of analysis that the components 
of {w(t) }and{v(t) }are independent of each other, the covariance 


matrices are readily written down as 


i A strict-sense stationary random process is defined as one for 
which all density functions are independent of absolute time 
reference (time origin) [45]. 
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2.6 Simulation studies of a typical system 


Having specified the three-vehicle stochastic model (2-3) 
with the observation matrix C set equal to the identity matrix and 
with the autocovariance matrices W and V as given by (2-10), the 
optimal steady-state stochastic control system will now be designed 


for the case where the performance index Je(u) is given by 


PO Po 


s 
Lu = ae | [10 (ws ( t)+5W5(t)) + sf*(t) + 8fe(t) + 


‘i 
6f5(t)] dt } (2-11) 


From subsection 2.4.2, it is known that the optimal system 


is specified completely (and uniquely) by the steady-state covariance 





tlie 
Note that this performance index is a direct extension of the one 
given for the three vehicle deterministic regulator of appendix one 
(except for the constant factor of 1/2 in front of the integral 
sign). This should thus allow easy comparison of stochastic and 
deterministic regulator design. 


(of-S) 





(€-S) fobom sitzsloote gfotdev-seNdt ane ee esival 
bas xintem yttinabt srt’ ot [supa J92 9 inten noftevrsedo ati Ag rw 
aft .(0f-8) vd mevip 26 V bane W 293, (1S'5m 9916 fPIBVvOsOS U6 ails ag tw 
beaptesb ad won [Tiw moseye fownos aisesoose otsda-ybood2 Tamt3qo ¢ 
yd Wevip 2f (u) qb xabnt sanemoimysg add svotw sano at ctl 
T : 

+ (fe hs (+)¢ 748 + ((3 awa ( +)F $3) OU] \4 ; 
0 





if 
(T1-S) th [(9)p% 





0 


matrix 2 of the filter and by the optimal feedback gain matrix L*. 
From the steady-state solution of equation (A3-6) with £(0)=0 (or 


from equation (A3-7)), Z, is found to be 


0.406 Or Eo | 0.007 0.008 0.001 
Oris 12399) 03143-07102) -0-008 
Rigel 007 -0.143 0.406 0.143 0.007 (2-12) 
0.008 =O 102 0.143 13 oe =. 1.0. 
0.00] -0.008 05007 r=0 5151 0.406 


The optimal feedback gain matrix is (from subsection 2.4.1) identical 
to the one derived for the deterministic regulator of appendix one. 


Hence, 
u*(t) = -R 'B'K x(t) = - L*x(t) (2215) 


where K is given by (Al-6). 


The resultant system to be simulated is thus as shown in 
figure 2.3 (which is a specialized version of figure 2.2) with L* 


andi opegivensbye(2=13)eand (2-12), respectively. 
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FIGURE 2-3: Block diagram of the simulated 
optimal stochastic regulator (OSR). 


Let us now briefly see what sort of effects the inclusion of a 
Kalman filter in the feedback path is expected to have. Separating 


the deterministic and stochastic components of x and Xs 


|x 
bx 
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then gives 


(Kp + Xoy) = AlXp + Xx) + Bu tw 


Now, 


[X) -(A-BL*)xp] + key = AxXgy + B[-L*x¢] + w (2-14) 


Since the deterministic component evolves according to 


(2-15) 


Shea Ad ape) 
is the estimation error. 


For the system where no Kalman filter is present it can similarly be 


shown that 


y 7 (A-BL*) Xey + (w > BL* v) (2-16) 
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where x is now defined as 


Comparing equation (2-16) with equation (2-15), it is seen 
that if the Kalman filter is working properly, implying that 
Lloyl l<<t IMs then the filter can very effectively reduce the 


stochastic effects due to the measurement noise vector wit Je 


2.6.1 Simulation of system disturbances 


In evaluating the effectiveness (through simulation studies) 
of the Kalman filter in improving vehicle performance, it is important 
to first of all see how well the simulated system realizes the mathematical 
one. The use of a digital computer to simulate the mathematical 
models presented, among the usual difficulties associated with digital 
integration techniques, added problems connected with the simulation 
of system disturbances. Taking into consideration the technique used 
for generating a random number in the IBM System/360 CSMP program, 
it remains to be shown that the simulated noises do fulfill the re- 
quirements of the mathematical model (e.g. with respect to mean, 


; ! ; : 2 12 
variance, independence, and white Gaussian assumptions). 


i 


& In appendix two a brief indication of the workings of the IBM/System 
360 CSMP is given. A short description of several problems encountered 
in the course of simulating the various mathematical models 
developed in this thesis is also provided. 


norset uf 


Jb 


DATYV IG 


t ¢ 


e\y 


bseu suprnnoass sit 
emerporg GMe) Ode\ 
-87 sat [[PtTut ob 


nes oF 


SI 


+95 


Ses 


‘ar-S) nottsups Attw (a/-S) nofisups ontysqma) 


nar 
t\ 


e * ‘ e . rs aa 
atelumt2 ot xetuqmoo Tstipth 6 Yo sey 3a {Sno r 


ot oh 


' 
mateve Mal ens vt ~admiun mobnst 5 pntverens i 
egeton bssalumre sh Jens nwortz sd.o3 ants 
ray maa ry . ee 
.(znortamuzes nsteeusd ottay | bei +3 ‘abnaqabni « SONG FE 
i ¢ f 


er to 2pntayvow ‘ont 7 
Shaw PP idcetey to norsq! 


7 

yinagora pdttiow 2f vod tt memlet ody tt deds 

i ’ -_ 7 

s9tts Wiav neo VatTTt sat nSAs » 

s>ton Inomovuesem dad of -aub egastte oftesngage : 
zoonsdiuteth matey2 To nots Tumr2 if Ai 

dpuovat) eesnavidastts sat porisulsvs ~ 


yaq sfotdey pntverqmr nt vedht? seater sit to 


esrtiuottt(rb feveu sng proms. ,bestas2a1g 2febom ] 
b9 tos inoo 2meldoyg babbs ,2suptnnoss a’ i 






















44 Wee x: gt * 


is 
el lot 
’ 


ie)" 


v2 hotefumte odt Plow won 992 Tis To tert? of 


elt 9 ze 


tsvabtenos ofnt pntdeT -esonedvatetb ngtaye % 


i~ s ai 
- 


i 


ey Adiw .9.8) fsbo .atihnairi a to aanenestup 
7 







a > 






on a 
- _ : 
- 
7 a a 
i. —_ Pi ) 
> £ 


S0 


Table 2-1 gives some data concerning the mean, standard 
deviation, minimum and maximum values for ten Gaussian noise sources 
used in this thesis. The zero mean and unit variance required of 


each noise source is seen to be fairly well satisfied. 


To ascertain if the noise sequences are independent, a 


correlation analysis is carried out for every possible combination of 


i 


the ten random sequences (taken two at a time). Define the 


correlation coefficient of two random variables x and y as 
be ee eh es] Sie cod (2-17) 


where Cy is the covariance between x and y, and oooh are the 
standard deviations of x and y respectively. The two random variables 


are said to be uncorrelated if the correlation coefficient is zero. 


Table 2-2 gives the correlation coefficients for each pair of 


14 


noise sequences described in table 2-1. It can be seen that (in 


ee eee a ee sR 


ik Since the noise generator, GAUSS(->:,-), produces a sequence of 
numbers having a Gaussian distribution two random variables which 
are mutually uncorrelated are also independent [6]. 


oy Results were obtained using the "Simple Correlation and Plotting 
Package" (CS022) available at the University of Alberta Computing 
Center. 
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SOURCE MEAN STD. DEV. 
1 -0.0124 0.9980 
2 -0.0146 0.9712 
3 0.0374 0.9936 
4 -0.0099 0.9925 
5 -0.0018 1.0135 
6 -0.0545 1.0156 
7 -0.0675 0.9487 
8 0.0466 0.9398 
9 -0.0391 0.9960 
10 -0.0588 0.9971 


TABLE 


* 
Ten simulation noise sources 


2-1 


= 


=3) 


MIN. VALUE 


2333 
21) 


nOL2/ 
. 1666 
8523 
ec] 
0999 
. 6288 
. 0470 
THE! 
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MAX. VALUE 
3. 
as 
3 
34 


1473 
8653 
6630 
4578 


gol ce) 
.0076 
4462 
. 0008 
.014] 
. 8905 


ne 


These estimates are based on a finite data record consisting of 


601 points for each of the ten noise sequences. 
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magnitude) the largest correlation, 0.093, occurs between random 
generators 1 and 2. Thus, although some correlation between souces 
does exist the degree of correlation is not significant and can be 


dismissed. 


For each noise source present in the modeled system, the CSMP 
program calls subroutine GAUSS once at each iteration cycle, where- 
upon a Single random number is generated for each integration 
interval. Given the integration interval, the noise cutoff frequency 


is then specified automatically as 


2 ] 
Les eel UAT) ca 


where AT is the integration interval specified for the CSMP integration 
wpe Taking the integration interval to be 0.01 second (see 
appendix four), the cutoff frequency of the noises is then given by 


(2-18) as 50 Hertz. 


Sectioning a single data record into twenty non-overlapping 
sections of 1024 data points each, and using a method described by 


P.D. Welch [43], an estimate of the power spectra of the random 


15 

Note that the use of a digital computer for noise simulation has 
eliminated the aliasing problems encountered in digitizing continuous 
data. It must be borne in mind however, that given the fixed 
integration interval AT, no frequency component at a higher frequency 
than ie can be modeled adequately. 
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number generator GAUSS is obtained../° The resulting power spectral 
estimate, normalized to its maximum value, is shown in figure 2.4. 
The interval from -15.54 decibels to 3.33 decibels includes the true 
Spectrum with at least 90% certainty. Evidently, the random 

number generator does not, by any means, approximate the ideal white 
noise source. Spurious peaks (ranging from a maximum of 0 decibels 
to a minimum of -12.75 decibels) occur throughout the frequency 
spectrum. | The peaks do seem to occur rather uniformly throughout 
the spectrum however. Moreover, a variation of approximately -13 


decibels between the maximum and minimum values cannot certainly 


destroy its usefulness as a white noise source. 


In conclusion then, it seems that the random number generator 
GAUSS is a sufficiently good representation of the noise source post- 


ulated by the mathematical model. 


2.6.2 Evaluating the performance of the optimal stochastic 
regulator 


It is useful to evaluate the performance of the optimal stochastic 


regulator. An examination of equation (2-5) shows that the objective 





ouoting P.D. Welch, "The method involves sectioning the record and 
averaging modified periodograms of the sections. . 
The Fortran program used here is given in appendix five. 


Note that these spurious peaks could have been somewhat further 
smoothed out by averaging over a larger number of modified periodograms 
than the twenty used here. 
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of the optimal regulator is to reduce the effects of the random 
disturbances w(t) and v(t) on vehicle performance. In the limit 
One could envisage a "perfect" regulator capable of completely 
filtering out system disturbances and thus give vehicle performance 
similar to that of the deterministic system of appendix one. 

Though obviously this "perfect" regulator is not realizable, one 

can still define an index of performance which gives some indication 


of how closely this ideal is approached. 


The mean-square deviation (MSD) between the state variables of 
the stochastic regulator, which includes both the optimal (OSR) and 
the non-optimal (NOSR) regulators of figure 2.2 and figure 2.1 re- 
spectively, and the state variables of the deterministic regulator 
(figure Al.2) can thus be used as a gauge of stochastic regulator 
performance. Hence, define the estimate of the mean-square deviation 


(MSD) of the system variable z to be 
(2-19) 


where Zp(k) » z(k) are the deterministic model response and the 
stochastic model response at time kAT, respectively, and No is the 
number of sample points used in the estimate. Since 


Z(t) = z.(t) + Z,(t) 
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where (Z.(t)} is the zero mean process which is the resultant 
stochastic effect of system disturbances on the variable z(t), 


the MSD of equation (2-19) then becomes 
N 
ies 2 
MSD = 7- J 25(1)] (2-20) 
k=0 


For large Ni» performance measure (2-19) thus indicates the variance 


of the disturbance term affecting z. 


Note that definition (2-19) permits computation of the MSD 
of the disturbance in the state variable x without regard for the 
deterministic response of the system. This is quite useful in that 
it can thus be calculated while concurrently observing the deter- 


ministic and stochastic response of the system 


In all simulation runs to follow, the estimate of the mean- 
Square deviation was computed using 501 samples of the variable z(t) 


from time t=0 to time te=k A T where k=500. 
2.6.3 Simulation results 


In this subsection the OSR (optimal stochastic regulator) of 
figure 2.2 will be simulated for the two cases where the filter does 
and does not have exact knowledge of system disturbances. Its per- 
formance will then (for equivalent operating conditions) be compared 


with the NOSR (non-optimal stochastic regulator) of figure 2.1. 
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In all simulations the vehicle queue initial conditions are 


18 


Such that bY 1=5¥9=6Y3=05 6W)=-4.2, and bWo=2.1. The corresponding 


filter states can oe ae and cae Ba respectively) are given identical 


conditions at time nef Ve 


Whenever a simulation run incorporates the Kalman filter, the 
filter invariably assumes that the noise autocovariance matrices W 


and V are both identically equal to the identity matrix. 


a. NON-OPTIMAL STOCHASTIC REGULATOR (NOSR) SYSTEM - Table 2-3 


gives the mean-square deviations of various system variables for 
several values of noise variance. The observed response of the 
position and velocity errors are shown in figure 2-5 and figure 2-6, 
respectively, while the controller input signal (here called "measured 
State") for state variable 6Wy >» and the control signal for the 


second vehicle, OF os are shown in figures 2-7 and 2-8, respectively 


(plant and measurement noise both have a variance of one).5° 


'Bvote that these are the same initial conditions used to obtain the 


deterministic regulator response shown in appendix one. The non-zero 
initial conditions allow concurrent observation of the deterministic 
and stochastic components of the vehicle queue response, and also 
allow easy comparison with the deterministic model response. 
the filter initial conditions are set identically equal to the plant's 
in order to avoid the tracking error that would otherwise result at 
the starting time. 
20the Superimposed smooth response, on these and subsequent graphs, is 
that of the deterministic noiseless system of appendix one. It is 
provided for purposes of comparison. 
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The indicated results clearly point out the serious consequences 
for vehicle performance that system disturbances can have. What 
is even more striking however, is their effect on the required 
corrective forces needed to maintain the steady-state condition. 
From table 2-3, for example, it is seen that (for a noise variance 
of one) in order to maintain the mean-square velocity deviation of 
the first vehicle at 0.0085 the corrective force, OF) mean square 


deviation required is 9.5185. 


b. OPTIMAL STOCHASTIC REGULATOR (OSR) SYSTEM - Table 2-4 gives the 


mean-square deviations of various system variables for several values 
of noise variance. In all cases, the designed Kalman filter assumes 


(for both measurement and plant noise) a variance of one. 


Figure 2-9 to figure 2-13 gives the graphical responses of 
several variables when the filter has exact knowledge of the system 
noise (i.e. the actual noise variance is one). Figure 2-14 to figure 
2-18 show the graphical responses of those same variables when 
the filter has an inaccurate description of system noise bie: actual 


noise variance is 9.0 but the filter assumes it to be 1.0). 


The remarkably improved response that the Kalman filter makes 
possible is quite obvious. As a comparison with part a (no Kalman 
filter), to maintain the mean-square velocity deviations of the first 
vehicle to 0.0024 requires a corrective force mean-square deviation, 


SF,, of 0.0070 (for a system noise variance of one). 
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TABLE 2-3 45 


Mean-square deviations for the NOSR system 


MEAN-SQUARE DEVIATIONS 
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The values are given in the following order (subsequent tables 
included) 
x=state variables 
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[oy 1 SW, 6¥56Wod¥]' 
y=measured states = [LY Yo¥3V a5] 
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TABLE 2-4 


Mean-square deviations for the OSR system 


WO RP BW WwW o_O 0 
Sola iara SIS: 
ees eee Qe ee) &] SB QeoqQeS 
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* These are given for [oy 1 6W7 6¥p5Wo SY] '. The values are obtained 
using equation (2-35) and replacing the deterministic model response, 
Zy(k) > with the actual state response, Z(k). It thus gives the 

MSD between the estimated and the actual system states. 
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FIGURE 2.10: Vehicle velocity deviations with the OSR:04=1. 
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FIGURE 2.13: Control for second vehicle (sF,) with the OSR:o4=1. 
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FIGURE 2.18: Control for second vehicle (SF) with the OSR: oy=9. 
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c. SYSTEM WITH DISTURBANCES HAVING A UNIFORM:DISTRIBUTION- The equations 
for the conditional mean estimate hinge on the linear-Gaussian 
assumptions. If the Gaussian assumption is relaxed, then (2-8, 2-9) 


do not give the conditional mean estimate [42]. 


Table 2-5 and table 2-6 give the mean-square deviations for 
the NOSR and the OSR, respectively, in the presence of system 
disturbances having a Normal distribution. Unlike the previous 
regulators subjected to Gaussian random disturbances, it is now 
noted that the ability of the OSR to regulate the position of the 
controlled vehicles is actually less than that of the NOSR. This 
is a direct result of the inability of the Kalman filter in the OSR 
system to accurately estimate the actual vehicle states. Since cost 
function (2-11) forces the regulators to take corrective action in 
the presence of positional errors only, the poorer position 


regulation achieved with the OSR system is readily explainable. 
2.7 Conclusions 


As a sequel to the qualitative work reported by Anderson and 
Powner [1], a comparison of table 2-3 with table 2-4 clearly 
indicates the immense improvement in vehicle response obtainable with 
the OSR; over that obtainable with the NOSR. Figure 2.19 graphically 
compares (for noise variances of from 1 to 16) the mean-square 
deviation of the velocity variable, 6Yy> and of the corrective force, 


6F 1s of the first vehicle, when the NOSR and the OSR are 
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TABLE 2-5 


Mean-square deviations for the NOSR system : disturbances have a 





Normal distribution. 





TABLE 2-6 


Mean-square deviations for the OSR system : disturbances have a 





Normal distribution. 





* Comments in the footnote of Table 2-4 apply 
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FIGURE 2.19: (a) MSD of velocity error variable of first vehicle, 
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al ; A , : 
employed. It is seen that, as the noise variance increases, 


the OSR system gives a better response than the NOSR system even 
though, except for the case of unity noise variance, the filter 
in the OSR system does not have exact knowledge of system dist- 


urbances. 


By far the most obvious effect of the filter is its 
phenomenal reduction in the magnitude of the required corrective 
forces to maintain a relatively stable steady-state queue condition. 
Figure 2-19b compares the mean-square deviation of the corrective 
force oF, applied to the first vehicle of the queue when the filter 
is and is not included in the system. The attendant benefits that 
this has for passenger comfort and system operating costs have 


been discussed in chapter one and will not be considered further here. 


Given the vehicle queue with both plant and measurement 
disturbances (having a Gaussian distribution) the optimal stochastic 
regulator system thus consistently permits better vehicle re- 
gulation even though the filter in the OSR may not have exact know- 


ledge of system disturbances. 


i 


2 It should be apparent from the previous discussion that when the 


OSR is used, the filter estimate is optimal only for the case 
where the actual noise variance is 1. Had the filter been re- 
designed each time the noise variance changed, the MSD of the 
system states with the Kalman filter would have shown a rather 
horizontal relation. 
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CHAPTER THREE 


THE VEHICLE SYSTEM WITH 
PLANT NOISE AND FEEDBACK TIME DELAY 


ABSTRACT 


An optimal closed loop control scheme incorporating a least 
mean-squared predictor is first developed for a three-vehicle 
system with plant noise and feedback time delay. Optimal re- 
Qulators are designed for two different performance criteria. 
These resulting optimal closed loop systems are then simulated with 
different amounts of time delay in the feedback loop. The effects 
of an incorrectly assumed feedback delay on performance is also 


examined. 
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3.1 The least-mean squared predictor and feedback control 


Consider the stochastic steady-state vehicle queue model 
described in sub section 2.1 and suppose that now (as discussed 
in chapter one) there is a time delay between the acquisition 
of the state measurement x(t) and the generation of the required 
control action u(t). The state-output equations of the vehicle 


queue can thus be taken as 


x(t) = Ax(t) + B u(t) + w(t) | (3-1a) 


I< 
— 
ct 
~~ 
" 


x(t-r) (3-1b) 


where t is the time delay. Equation (3-1b) assumes a completely 
undistorted controller input signal y(t) of the delayed state x(t). 
The admissable control input which minimizes the quadratic cost 
function Je (u) of equation (2-5) subject to dynamic constraints (3-1), 


u*(t), is now desired. 


It is a well known result that the form of the prediction 
process is expressed as the conditional expectation of x(t), 
ase a Si] 
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Mit EIx(t)/Vio)euc st} ). (3-2) 
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Since the estimate is to be obtained in terms of the received 
Signal (output) {y(c),o0<t} the state x(t) should be expressed 


as a function of y(t). We therefore write 


y(t) = x(t-r) = A x(t-r) + B u(t-r) + w(t-7) 


i 
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ct 
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Ww 
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uw 
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If we let 


y(t) = y(t) + yo (t) (3-4) 


where Yp(t)s Yo (t) are the deterministic and the stochastic parts 


of the system output respectively, then equation (3-3) becomes 
(yp(t) + ¥o(t)) = Alyp(t) + ¥o(t)) + B u(t-t) 
+ w(t-t) ; (3-5) 
y(t) is a purely random, zero mean, white noise term because of the 


assumptions on w(t). From the linearity of the system, the state 


variables can then be separated to obtain 
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Yo(t) = A ye(t) + w(t-r) (3-7) 
Now, from (3-4) and (3-1b) we have 


y(ttrt) = Yp(t+r) eye tt) eet) a (3-8) 


The conditional expectation of x(t) given by (3-2) can be re-written 


in view of (3-8) as follows 


(RES ix(t)/ylo)yo<t} 


Ix > 


Efyp(ttr) + yo (ttt) /y(c) ,o<t} 


Yy(ttr) + E{y. (ttt) /y(o) ,oxt} : (3-9) 


A 


The least mean-squared predictor, x(t), now requires specification 


of the second term in (3-9). 


The solution of the differential equation 


Yo (ttt) = A Yo (ttt) + w(t) (3-10) 


is given by 
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pM ttr-o)w(g-r)do (3-11) 


or 
Yo (ttt) = yo (t+) + [Mt odyocoe 


where 
ie 


i A(t+t-t,) i A(t+t-o) 
Q Yo (ty) + Q w(o-t)do 


Zs 


& 
— 
Gr 
+ 

a 

HH] 


Yo(t+r) is the estimate of Yo(ttr) based on the observation of white 


noise up to time t. 
ie 


) A(t-c) 
Yo(t,) +f 2 w(o-t)do} (3-12) 


yo( ttt) es {2 
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From 


GiVen {V¥icjauo = tl, yo(t+r) is determined. 


Thus 


E{yo(ttr)/y(o)s as t} Efyo(ttt)/y.(o)s BU} 


A 22 


oe ATA (3-13) 
The least mean-squared predictor is then given by 
x(t) = Yp(ttr) + 2" ye(t) (3-14) 
From chapter two, the optimal feedback control is 
u*(t) = o(t, x(t)) (2-6) 


Le , 
Kleinman [23] obtains a similar result. 
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which, for reasons previously discussed, becomes 
u*(t) = -R-'B' K x(t) = - L* x(t) (3-15) 


Figure 3.1 shows the optimal stochastic feedback system. 
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FIGURE 3.1: Optimal stochastic feedback 
system incorporating a least 
mean-squared predictor. 
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3.2 Simulation studies 


In this section the performance of the optimal system derived 


in the previous section will be examined for several values of time 


] 2 


delay. Two performance criteria (cost functionals) will be used.°* 
: i 
1. deq(u) = E¢lim & | [1o(ow?(t) + ow2(t)) 
EI hell 2 
dances ] 
Y 2 2 2 
+ 6; (t) + 6f5(t) + 6f,(t) jdt 
} 
and, 
a 
ro 4 f 2 2 
2. J(u) = E¢lim= + [10(6wj(t) + 6wo(t)) 
E2\=— T i ] 2 
oy 
0 
+ A(syS(t) + sys(t) + syS(t)) 
) 
| 
+ 6f@(t) + 6fe(t) + oe 


| 


As was done in chapter two, the basic approach here will be to 
simulate the optimal system with time delay for the same initial 
conditions as those used for the deterministic regulator of appendix 
one. The performance of the optimal stochastic system and of the 


optimal deterministic system corrupted by driving noise and time 


ce Subscripts 1 and 2 are now introduced to differentiate the two 


cost functionals. 
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delay are compared with each other and with the ideal deterministic 
regulator. This is done by examining the graphical display of the 
response of each system and the computed mean-square deviation of 


the actual response from the ideal response. 


3.2.1 The simulated system 


As seen from figure 3.1, design of the least mean-squared 
predictor essentially consists of a calculation of the matrix 
exponential, exp(At), where t is the feedback time delay. Since 
the two systems to be simulated differ only in their index of per- 
formance the value of exp (At) will be the same for both and will 


thus be calculated now. 


CALCULATION OF EXP(Az) 


The series solution for the exponential of the matrix At, given by 


is amenable to computation using a digital computer. A conveneint 
recursive scheme is provided by noting that each term in parentheses 
is equal to the entire preceding term; the computation being carried 


out to only enough terms so that additional terms are negligible 
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in comparison with the partial sum to that point [35]. Table 3-1 


gives computation results for several values of time delay vt. 
SYSTEM WITH COST FUNCTIONAL Jey (u) 


Cost functional Jey is identical to that used in chapter two 


and hence the optimal feedback gain matrix L*, given by 


is identical to that used previously (K is given by equation 


(A1-10) of appendix one). 
SYSTEM WITH COST FUNCTIONAL Jeo(u) 


To place the cost functional in the required form of equation 


(2-5) requires that the matrices Q and R be specified as 


0 
Q= 0 ] 0 0 0 | and R= 0 ] 0 ’ 
0 0 4 0 0 0 0 ] 
0 0 0 ] 0 
0 0 0 0 a 


respectively. Solving for the real symmetric positive definite 


matrix 


At 


7 












[-€ ofdsT . [8] Jsarog tend od mue iota bie wits iotw noe Mi po nt 
.F yBTob omit to eouley faysvse v0 2s twagt tua OD | eave 


ae iy © 
(uw) pg JAMO RE. $2 200 HTT a) eve 
ows vetqsdo ni beseu dent ot [s5tsngbt ot 43 fenottonu $209 pti 


iy 


rtp .*1 xtadem absp Josdbas? Ts: nftqY arid sone bas 


ups vd nevip 2t ») yl2uotvetq beey Jedd oF sorte 


.(sno xFbnaqds to nh, ; 


: —T 7 


(ut beg JAMOLTIMUAT209 TE 


Tee 
at 


34 ven 


Pi. 







fsup9 to mot bsrtiosy elt at [snottaaut gees ot sn6laq oT 


26 ; (ttosqe sd A bas 0 esotysem sat ssid esa tupey 
. { f) t | 
) ; 
er 1-9 i 0 = Dns 


Tt i 
: ” | | is Vy s 
Ae “ 3 Wb oh 209 one | 


’ , 7 | 
Ma : i 






ihe 


TABLE 3-1 
for several values of time dela 


8 


Exp(At 








coc @Becsoo soca 


ggoce = cE aH ag°*"| 





- ‘se. 2? ese f+ 8 Fe  *—*@ 


- ¢£ = «© «fF  « 2 - & «4 


eo e+ *& Of #@ o @ €°- FF *® 8 ~@ OL... © + = @ 


= ©) OC 0O wrt 
5 © 8 ae ve ci wa 
mt — oo ai oe) oo m 
“i wi C120 he wm 


ox 


76 
K = lim K(r) 
[00 
from equation (Al-7), with Q and R as above, gives 
iva aa QAM ALAR ae ie 


2.494 eeloy! -1.826 675 -0.668 | 
-0.586 -1.826 2.408 1.826 -0.586 





| 0.668 1675 12626 8.967 -2.494 
)70.272 -0.668 -0.586 -2.494 2.094 


The optimal feedback gains are then 


3.2.2 Simulation results 
SYSTEM WITH COST FUNCTIONAL Je7(u) 


Table 3-2 and table 3-3 give the mean-square deviation of the 
system variables (versus time delay) for the two cases where : 1. 
the least mean-squared predictor is excluded from the feedback path 
and,2. the least mean-squared predictor is included, respectively. A 


graphical representation of sample results is given in figure 3.2. 


Figures 3.3 to 3.6, and figures 3.7 to 3.8 graphically record 


the response of the system of figure 3.1 for delay times of 0.1 second 
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and 0.42 second, respectively, when the predictor is not present 
(i.e. this is equivalently the behaviour of the optimal deterministic 
regulator corrupted by driving noise and feedback time delay). 
Similarly, results for the case where the predictor is included 

are given in figures 3.9 to 3.12. For delays of less than about 

0.1 second the system response is seen to be fairly acceptable without 
a predictor. However, for larger delay times the system becomes 
quite oscillatory; approaching a limit cycle (for the positional 
error variables) at about 0.42 second. Figure 3.9 to figure 3.12 
clearly depict the usefulness of adding a predictor to those systems 
with relatively large time delay. It is there shown that a 
satisfactory response is obtainable at a time delay (0.45 second in 


this case) which would otherwise result in an unstable system. 
SYSTEM WITH COST FUNCTIONAL Jeo(u) 


Table 3-4 and 3-5 give the mean-square deviation of the system 
variables (versus time delay) for the two cases where: 1. the least 
mean-squared predictor is excluded from the feedback path, and 2. the 
least mean-squared predictor is included, respectively. A graphical 


representation of sample results is given in figure Sass 


Here too, the response of the system for time delays of less 
than about 0.1 second is fairly acceptable without a predictor. 
However, figure 3.14 and figure 3.15 now show that (unlike the system 


with cost Jey) the response at a time delay of 0.42 second is unstable. 


















insesiq ton 2i yosofba ig sis nerw ual fe 
2itetatosdsb Temttqo sdt to svotveded oft vitneleviups 2t tie goal 
.(yefsb smts sdobdbset bos szeton oniviab: Wi Sbeis0> ee 
bsbulant 27 rototbara sit svoiw sea9 Sao NOt 2ffuze .efaet ime 

tuods mBad 2eef To 2yslSb YoOq S18 08 @.£ earuer? ot navtp 916 
tuonstw sidsiqsocs yfaist sd oF nese 27 SenogeRy mateye ortt baoose 1.0 
esmorsd moteyz odd esmtt Vefeb ySp46) qo? “YavewoH Todo tbeg 6 
fsnotsteog sit yot) sfoyd simif s ontdosovggs svvose!lis20 estup’ 

Sf.€ sywpt? of @.£ svupt? .bmodez ShIO tuods $6 (2efdstasy yore 
amas2zye s2ont oF rotatbeyq s pitbbs to gesnhotsew sit Jotqeb: seo 
6 Jed} nwode ovesdd 27 ST .NSiSsbh omit Spal ‘Ulovtsatiel attw 

i Bnoos2 ¢h.0) yslob omit 6 $5 sldsqtesdo ef Sehogesy yrodosbeldse 
.nateye efdedenu ne at tfveer setwien to) biiiow Noidw (9269 ert 





mos2ye ani to aotisiveh sysupe-nsom' ont SVip ¢=b” ne 9-6 stat | 
Jess! sit .f :at9tw 29250. owt oft Yo? (ysiab amb, ‘elighav) ‘diehavy ey i 
, 

: , 


9d3 .S bons ,ftsq Assdbsot ard movt babi foxe et fever or 


fevinigsye A .visyidoagear babul ont ar ototieng bi 215 9 





'@ 


£16 swph? nt rout af 2 it aie 
et ai os + hein oo 0 at 
Me Rice att ae ie 





> 


is 
F : } 


TABLE 3-2 78 


* 
Mean-square deviations without predictor : cost Jey 


MEAN- } wesn-squnne Deviations DEVIATIONS 
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t The MSD for the time delay problem is calculated by comparing 
the deterministic and stochastic model results at the corresponding 
iteration cycles. 
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TABLE 3-3 


Mean-square deviations with predictor : cost Jey 
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Comments in the footnote of table 2-4 apply. 
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FIGURE 3.4: Velocity deviations with no predictor +t=0.1 second. 
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FIGURE 3.5: Measured state of 5Vy with no predictor: 1t=0.1 second. 
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FIGURE 3.7: Position deviations with no predictor: 1=0.42 
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TABLE 3-4 


Mean-square deviations without predictor : 


MEAN-SQUARE DEVIATIONS 
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TABLE 3-5 


Mean-square deviations with predictor: cost Jeo 
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FIGURE 3.15: Control for second vehicle (SF) with no predictor: 
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Several phenomena that are noted from a comparison of table 
3-5 with table 3-3, and of figure 3.14 with figure 3.7 are now 


mentioned; together with a simple theoretical explanation of each. 


The difference in deterministic response - The deterministic 


response of the regulator is, from equation (3-6), 


Since the feedback gain matrix, L*, that relates the control 
variables to the measured variables depends upon the specified cost 
function, the deterministic response, Yp(t) » changes with the index 


of performance. 


The mean-square deviations of the predicted state - It can 


easily be shown that, for either regulator, 


(x(t) - xp(t)) = + 27 [A ye(o) + w(o-t) Ido (3-16) 


The mean-square deviation of each of the predicted states should 
thus be comparable for both regulators. Table 3-5 and table 3-3 


bear evidence to this. 


The mean-square deviations between the actual and the predicted 


State - Here, it can also be shown that, for either regulator, 
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(x(t) - x(t)) = - x,(t) +f om ,t + wlo-r)] do (3-17) 


The mean-square deviation between each of the actual states and 
the corresponding predicted states should then also be comparable 
for both systems. Table 3-5 and table 3-3 show that this is the 


case oe 


Comparing equation (3-17) with equation (3-16) it is also 
evident that, for either regulator, the predicted states should 
approximate the deterministic regulator states rather more closely 
than the actual states of the system since 


t 


[(x-x) - (x-xp)] = - (x-Xp) = - Xo(t) - [ts + w(o)] do 


Comparing column six with column four of table 3-5 (or table 3-3) 


again shows this to be true. 
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The exact agreement in MSD noted here in table 3-5 and table 3-3 
(unlike that for the MSD of the predicted states) is most likely 
due to the way the IBM/System 360 generates the random noise 
sequence. If the noise sequence generated differs from one 
simulation run to the next, but if w(t) has some fixed relation 
to w(t-t), it is possible that, whereas the value of equation 
(3-16) may vary at each simulation run, that of equation (3-17) 
can remain fixed. 
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3.3 Predictor performance when the time delay is not exactly known 


Let o(t,t,) be the state transition matrix of the linear 


homogeneous vector matrix differential equation 


where A is the constant matrix of the plant. Then, from equation 


(3-1) 
ier 
y(t) = x(t-t)o(t-z, t,) x(t) +! 6(t-1,0) B u(c)do 
J 
tO 
Aes 
+ J @(t-t,0) w(o)dos t-t > t, (3-18) 
t, 
Let the assumed system delay be Tp such that 
(3-19) 


where Xpp(t) and Yop (t) are the state and output vectors of the 
Then, 


deterministic portion of the filter model, respectively. 


Upp(t) = Xpp(t-rp) = #(t-tpsty) App (tp) 


Eaip 
(3-20) 


, ) B u(c)do; t-t) > 
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where Xpp(t,) are the initial states of the filter plant model. 


Since Xyp(t,) and x(t_) are set such that 


0 


then it can be shown that, if Tp=Ts Y¥o(t) (shown in figure 3.1) is 
given by 
p t-t 
Ye(t) = y(t) = yop(t) = | o(t-r.0) wlo)dost-r > t, (3-21) 
tO 
Y¥o(t) is the result of a linear operation on the Gaussian white 
noise vector w(t) and hence, Y(t) is also a purely Gaussian white 


noise vector and equation (3-13) is valid Bie. 23]. If, however, 


the system delay, t, iS not exactly known but is assumed to be 


where t, iS the difference between the assumed and actual delay, 


then it can be easily shown that 
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Unlike the previous case where Tp was equal to 1, Y¥o(t) now contains 
a deterministic component due to : (i) the difference in propagation 
of initial conditions (first term on right hand side of (3-22)), and 
(ii) the difference in applied control action (second term on the 

right hand side of (3-22)), in addition to the Gaussian white noise 
of (3-21). Hence, the statement of equation (3-13)is here entirely 


inappropriate and 
ELyc(ttr)/yc(o), o < t] #2" ye(t) 


From an examination of equation (3-22) and figure 3.1 several 


comments can be made about the possible behaviour of the system when 
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the filter has an inaccurate estimate of the system time delay. 


Na Tsele Wiles Mer Tp (whichever is smaller) only the deter- 
ministic portion of the vehicle response is controlled. Random 


disturbances are completely unaffected by the control effort. 


2. The system with a predictor having incorrect information 
on the system time delay does not perform in the same fashion as 
that without a predictor and with a time delay equal to the 
difference between the assumed and actual delay. This is easily 


seen by noting that in the latter case 
Wet eee Leet) a -" x (tome) 
peo Lt Ax, { tt) + y(t) ] (3-23), 


where Y(t) is here the stochastic component of y(t). In the former 
case 
s A 


QM) So Ts Bato) = EM Ge se ee (3-24) 


where Y¥o(t) is now given by equation (3-22). 


3. For t > t,t, (whichever is larger) filter behaviour vastly 
deteriorates and, unless eel is small, system performance may be 


better without it. 


Figures 3.16 to 3.19 prove the correctness of the forementioned 


notes. 
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FIGURE 3.16: Position deviations with predictor: 1=0.50 second, 


tp=0.30 second. Cost Jey: 
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FIGURE 3.17: Velncity deviations with nredictor: t=%.5", to=.30. 
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FIGURE 3.18: Predicted state of éw 
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with predictor: 1=0.50, 
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FIGURE 3.19: Control for second vehicle (5F,) with predictor: 


t=0.50, + 
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3.4 Conclusions 

Whereas regulator response may be quite acceptable for short 
time delays (about 0.1 second or less) without a predictor, it 
rapidly deteriorates as the delay is increased and soon becomes 
unstable. The exact point of instability is dependent on the 
type of system employed. It has been shown in this chapter that 
the inclusion of a least mean-squared predictor ensures acceptable 
vehicle performance even in the presence of relatively large 


feedback delays. 


Inexact knowledge of system delay time is,however, seen to 
be quite detrimental to overall system performance. Nevertheless, 
considering that the delay time can be estimated quite accurately, 
this latter effect need not be of serious concern to the system 


designer. 
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CHAPTER FOUR 


OPTIMAL STEADY-STATE CONTROL OF VEHICLES 
IN THE PRESENCE OF MEASUREMENT NOISE 
DRIVING NOISE AND FEEDBACK TIME DELAY 


ABSTRACT 


For the system having both plant and measurement noise as 

well as feedback time delay, it is shown that the optimal control is 
generated by the cascade combination of a Kalman filter and a least 
mean-Squared predictor. The results of simulating the optimal ly 
controlled vehicle system with plant and measurement noise of unit 
variance together with a feedback time delay of 0.3 second are given. 
The observed response of the optimal system when the filter and 
predictor have no knowledge of the initial vehicle states is also 


presented. 
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4.1 The optimal system 


In chapter three it was shown that (see equations (3-14) and 
(3-15)) the optimal control when the system has plant disturbances 


and feedback time delay is given by 


: A 
u*(t) = -L* xo(t) = -L*typ (tte) +2" "ye (t)} (4-1) 
where 
t-t 
Y(t) = | o(t-t,0) w(c) le 8 Lee ty : 
0 


To distinguish the least mean-squared predictor estimate of x(t) of 
chapter three from the Kalman filter estimate of x(t) of chapter two, 
the notation x is now used in referring to the former. The latter 
will subsequently be referred to as hie If a measurement disturbance 


term is now appended to equation (3-1b) such that 
Ce eect) meV (Lage) (4-2) 


then Yo (t) becomes 


BOT 











bas (M{-6) enofisups sez) J6dt nwoda daw 9h seed astqeto nt 
zoonsdvutetb tnsiq 26 msteye ont modw Tovtnes Femitqo ont ((@f-£) ; 
vd nsvie at yetab mtd dosdbest bas 


(Tb) Ct) uae rt) ite = (Ady ‘J = (ee 7 
| nee a qapeare 
i> _ eae - 
of Sd Ew (o)w (n.7-2)8 |= (a a . 
pow 


to (t)x to atsmttzs vosorborg bersupe-nsem sesal atts ‘detuontsetb ot : 
<Ows yaiqsds to (+)x to stamtdes yoshi? nemiey ant wort en “J 
yosief sdT .1girro?t siz oF patvyetey af beep aan 2h oe nolisgan ol. 


spnsdvutetb tnomexwesom 5 TI. yk 26 oF bsristey Sa Ghsisupscl th. I 
Sedt dowe (df-€) notteups of bSbreqde won OA 4 


(r-t)y + (3) x * (ay | 


109 


t-t 


Y¥o(t) = foter wo) do + v(t-1)3 t-t ate 
t 
0 


= Xg(t-t) + v (tet) (4-3) 


Reduction of the stochastic effects of the control effort u(t) 
in equation (4-1) thus requires that Yo(t) » the stochastic dis- 
turbance term, be made as small as possible. In chapter two it 


was shown that, with no time delay, 


where x(t) is the Kalman filter estimate of the state x(t), and 
Sy(t) is the estimation error. It must be noted that | Ley (t) | I<<]1y(t) | | 
if the filter works properly. If the input to the predictor is taken 


as 


Yy(t) = xy(t-1) = x(t-r) + Sy(t-7), een) 


Yyg(t) = Xe (t-1) + Sy(t-x) (4-5) 
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and | ¥eg lt) [1<<|l¥e(t) || (Compare equation (4-5) with equation 
(4-3). 


Thus, it can be intuitively concluded that, for the case 
where the system is subject to both plant and measurement noise as 
well as feedback time delay, the optimal regulator should include 
both the Kalman filter and the least mean-squared predictor (LMSP). 
A rigorous proof of this conclusion has been provided by Kleinman 
[23]. A schematic representation of this optimal stochastic re- 


gulator with estimator and predictor (OSREP) is shown in figure 4.1. 
4.2 Simulation results 


Two cases are treated here. 
Case 1: Plant, filter, and predictor have identical initial states - 
A comparison of the performance of the deterministic optimal system 
of figure 2.1 with feedback time delay (here called the NOSRD), with 
that of the optimal system of figure 4.1 can be made by comparing 
tables 4-1 and 4-2. The mean-square deviation (MSD) recorded in 
these tables are as defined in chapter two. Figures 4.2, 4.3, and 
4.4 give the response of the noisy system with time delay when 


neither predictor nor filter is present.-” 


5 ; : ; : : : 
2 The simulated vehicle queue dynamics assume unity noise variance 


for both measurement and plant noise while the feedback delay is 
taken to be 0.3 second. 


Except for small random perturbations, when both the predictor 
and filter are included the response of the system is essentially 
that of the deterministic model of appendix one and hence is not 
repeated here. 
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TABLE 4-1 


Mean-square deviations with the NOSRD: 


onl, t=0.3 second 





TABLE 4-2 
Mean-square deviations with the OSREP: 


fale +=0.3 second 


0.0009 


0.0021 
0.0009 
0.00036 
0.0010 





T Comments in the footnote of table 2-4 apply. 
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FIGURE 4.3: Velocity deviations with the NOSRD: o,=1, 
t=0.3 Second. Cost Jey. 
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Case 2: Plant has different initial conditions from those of the 
predictor and estimator - Figure 4-5 to figure 4-8 give the response 
of the optimal system when the filter and predictor do not have 
exact knowledge of the initial plant states .©° After some time 

has elapsed, it is seen that the filter locks on to the plant 


states, and the optimal system performs in the usual fashion from 


then on. 


That the optimal system with the Kalman filter and least mean- 
squared predictor gives better regulator performance than the 
deterministic regulator of appendix one (in the presence of stochastic 
disturbances and feedback time delay) is certainly beyond dispute. 
Compared with the performance of the optimal deterministic re- 
gulator of appendix one in the presence of plant noise, measurement 
noise, and feedback time delay, it is moreover obvious that the 
optimal system of figure 4.1 gives not only better regulation, but 
what is also important, better regulation is achieved with vastly 


reduced demands on the vehicle power source. 


i 


ep Plant initial states = x = [0-4.2 0 2.1 0]! ; filter initial 


states = predictor initial states = null vector. 
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CHAPTER FIVE 


SUMMARY AND CONCLUSIONS 


ABSTRACT 


Several concluding remarks based on the work reported in 
the preceding four chapters are presented. Some suggestions for 


future research possibilities are advanced. 


FST | 7 
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5.1 Conclusions 


The work reported in the preceding four chapters of this 
thesis can be summarized as follows. It has been shown that an 
optimal stochastic controller can be designed for controlling a 
string of vehicles when random vehicle disturbances, state measure- 
ment noise, and feedback time delay are present. This controller, 
when implemented in the real world, will perform in a manner 
superior to that of the previously considered optimal deter- 
ministic regulator, which is optimal only when noise and time 


delay are absent. 


The severity with which plant noise, measurement noise, and 
time delay will affect vehicle performance in the optimal automatic 
system will, in large measure, ultimately depend upon the physical 
characteristics of the system employed. To name just a few : the 
communication network, system operating speed, vehicle power plant 
size, number of vehicles controlled, vehicle mass, will all be 
deciding factors in determining the control strategy. It is to 
be expected then that present studies can only concern themselves 
with general aspects of vehicle regulation with the hope of 
developing the means to obtain the best possible performance 


commensurate with economic and technical realities. 


Past work has shown that good regulatory systems can be 


designed by appropriate use of optimal control theory by assuming 
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that the physical components of the automatic system are capable 

of meeting the requirements of the controller. Since the power 
plant size will in general determine the accelerating capability 

of any given vehicle, many control laws will most certainly be 
limited by the need for a prohibitively large power source (with 
its obvious attendant impact on operating costs and passenger 
comfort). Because of its resultant effects on vehicle response, 
regulator power requirements cannot, moreover, be reduced by simply 
increasing the penalty associated with the expenditure of input 
control energy. An increase in the relative importance of expended 
energy would certainly reduce power plant size, but this may also 
have the attendant undesirable feature of forcing the system to 
fail in meeting its performance specifications. What has been 
shown in this thesis, however, is that by proper overall system 
design, not only can power plant size and passenger discomfort be 
significantly reduced, but, what is even more important, regulation 


as well can be enhanced. 


It has also been shown that the susceptibility of the control 
system to the corrupting influence of feedback time delay will 
hinge heavily upon the feedback control strategy that is used. 
Given that it is economically desirable to increase the number of 
vehicles which a single control center can handle (resulting in 


increased computation time for the required vehicle controls) it 
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is evident that a scheme for reducing the undesirable effects of 
the delay is certainly attractive. Moreover, since it is not 
certain how severe the effects of feedback time delay will be on 
final system performance, nor how large the actual delay will be, 
the inclusion of a predictor in the designed system may be more 


necessary than previously thought. 


5.2 Suggestions for future research 


A major concern in the area of optimal regulator design is 
attributable to an inability to specify, systematically, the per- 
formance criteria, by choice of the weighting matrices Q and R, 
and the noise covariance matrices W(t) and V(t) which will result 
in a desirable system response. Further research is required here 


to make the optimal design approach more attractive and less expensive. 


The plant noise considered in this thesis has served as a 
model for actuator noise and model uncertainties. Since modeling 
errors are certainly not white, it would be useful to study the 
effects of the introduction of colored noise into the design and 


performance of an optimal controller for a string of vehicles. 


Design of an optimal controller for use under emergency conditions 


is, undoubtedly, of grave concern. 


The effects of model nonlinearities on system performance and 


design are also worth considering. 
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APPENDIX ONE 


THE DETERMINISTIC STEADY-STATE 
VEHICLE REGULATOR 


Most of the research done on the position and velocity regulator 
has followed quite closely the original format proposed by Athans and 


Levine [27]. 


Modeling each vehicle in a string as a second-order dynamical 
system with non-linear damping, the equations of motion are written 


in the general form r30q"! 


N 


L(t) = y,(t) (A1-1a) 
my & Vey =a) lly, Celie thle K-1,2. 0.4 (Al-1b) 


where Z(t) and y, (t) are the position and velocity of the qth vehicle, 


h 


respectively, and f(t) is the force applied to the Ke vehicle at 


h 


time t. The mass of the Ke vehicle is given by my while N is the total 


number of vehicles in the string.“ 


a 


.] Motion is assumed to proceed along a flat straight guideway. 


we Figure Al-1 depicts a three vehicle string. 
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To write the equations of motion (Al-1) in terms of error 
State variables one then defines: 1. the deviations from a desired 
separation distance between adjacent vehicles Ay as the position 
State variable, and 2. the velocity deviations from the prescribed 
mean string velocity ua as the velocity state variable. Defining 
the state variables in this way forces the equations of motion of 
adjacent vehicles to become coupled and also allows linearization 


of the non-linear damping term about the mean string velocity Vo 


Thesresulpeis a set of Iinearizedidifferential equations for 
the position and velocity error variables, éw, (t) and by, (t) >» re- 


spectively, given by 


Se aw, (t) = dy, (t) - sy, 44(t) (Al-2a) 
sy, (t) = “SK ey, (t) +  o¢, (4) (A1-2b) 
dt k my k Mm. k 
where 
— ag Ly, (t)] 
yon ay, (t) 
y, (t) = Me 


is the first order term in the Taylor series expansion of the non- 


linear drag term, 9, [y,(t)], about the mean string velocity V). 


Interlacing the velocity deviations with the position deviations, 
the linearized state-output equations for an N-vehicle string can 


be written in the form 


5 
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(Al-3a) 


y(t) = C x(t) (A1-3b) 


where x(t) is the (2N-1) - dimensional state vector, u(t) is the 
N-dimensional control vector, y(t) is the r-dimensional observation 


vector, and A, B, C are (2N-1) x (2N-1), (2N-1) x Ny and rx(2N-1) 


matrices,respectively.’~ 


Specification of a quadratic cost functional of the type 


ed /: [x'(t)Qx(t) + u'(t)Ru(t)] at (A1-4) 


where R and Q are positive definite matrices then reduces the problem 


to the standard linear regulator problem of optimal control theory 


ean ees 


The control which minimizes J for any set of initial conditions 


- Note that in the vehicle regulator problem, the velocity and position 


deviations of every vehicle are measured. Hence, the dimension of 
the measurement vector, r, is the same as that of x(t), and the matrix 
C is the (2N-1)x(2N-1) identity matrix. 


A quadratic cost is specified for three main reasons:1. computational 
convenience, 2. equal penalization of positive and negative deviations 
in the state variables, and 3. penalization of large deviations 
relatively more severely than small ones. 

Since the quadratic cost does not provide for an infinite penalty 
when the vehicles touch,however, it is only valid under normal 
operating conditions[4]. 
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on the state vector x(t) is given by 134 


B'Kax(t) = = L*ax(t} (A1-5) 


K is the real symmetric positive definite constant matrix which can 


be found either by solving : 1. the non-linear algebraic equation 


1 


Panett kK BREBtY 01S 10. (A1-6) 


or 2. the matrix differential equation 


d 


S K(x) = K(x)A + ANK(t) - K(z) BR”! 


B'K(t) + Q (Al-7) 


with the initial condition K(0) = 0, and then setting 


K = lim K(x)" 


To 
Consider now the case of three vehicles where there are two 
position deviations and three velocity deviations. Assuming that 


Mm =m5=mMo= and O14 =On=O3=1 the state equations can be written ae 


AD The assumptions of controllability and no,terminal cost imply that 


the limit K(t) exists, is unique, and is K: that is [5] 
lim K(t) = K 
where K is the positive definite matrix which is the solution of(Al-6) 


ale Note that choosing m)=mo=m=1 in no way restricts the validity of 


the observed results. If mM #Mo#M7 15 then some other choice for 


the relative values of the weighting matrices Q and R of equation 
(Al-4) can be found such that the response is identical to that 
when all the vehicle masses are equal to 1. 
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ail) eee eee 0 
at sea 1) 0 6f,(t) 
POE Teh ea ae ] sf,(t) 
Oe OA ee le rel) 0 6f4(t) 
Go Oe) 0 
(A1-8) 


Choosing the cost function 


(oe) 


ee aI [10 (ws (t)+6w5(t)) + 6f 


O 


2 (t)4efo(t) +S (t) Jat (A1-9) 


then allows calculation of K. 


[ 1.263 2.494 -0.819 0.668  -0.444 


2.494 7.434 =1 826 We las -0.668 

k= |-0.819 -1.826 2638 1.826 -0.819 (Al-10) 
0.668 1123 1.826 7.434 -2.494 
-0.444 -0.668 -0.819 -2.494 1 elie) 


The optimal feedback controls are, from equation (A1-5), 


SF, (t)=-[1.2636y,(t)+2.4946w, (t)-0.8196y,(t)+0.6696w,(t)-0.444sy,(t)] 


éf (t)=-[-0.819sy, (t)=1.8265w, (t)+1.6386y,(t)+2.8266w,(t)-0.8196y5(t) ] 


2 


éf (t)=-[-0.444sy, (t)-0.6686w, (t)-0.8196y,(t)-2.4946w, (t)+1.2636y,(t)] 


3 
In figure Al.2, the resultant optimal system is shown in block diagram 


form. 
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The deterministic steady-state vehicle regulator is thus 
founded on the following five basic assumptions : 1. vehicle motion 
is along a straight flat guideway, 2. the linearized model for the 
vehicle dynamics is valid, 3. no system disturbances exist, 4. no 
time delays are present anywhere in the system, and 5. normal vehicle 


operating conditions prevail. 


A computer simulation of the three vehicle regulator was 
carried out on the IBM System/360 using CSMP. For the initial 
state vector [0 - 4.2 0 2.1 0]', the observed response of the system 
is shown in figures Al-3, Al-4, and Al-5, for the position, velocity, 


and force deviations, respectively. 





FIGURE Al-2: Optimal deterministic regulator system. 
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FIGURE Al.3: Position deviations for the no noise and 
no time delay optimal regulator 
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FIGUPE A1.4 Velocity deviations for the no noise and no 
time delay optimal regulator 
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FIGURE Al.5: Corrective force deviations for the no 
noise and no time delay optimal regulator 
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APPENDIX TWO 


THE CERTAINTY EQUIVALENCE PROPERTY 
OF OPTIMAL CONTROL 


This discussion of the certainty equivalence property of optimal 
control is a slightly more detailed version of that given by Tse [42]. 
A starting point for the discussion can be easily provided by noting 


that minimization of the cost function 


J(u) = £ lim + Oe a Ra) he (A2-1) 
requires prior prs of the possible stochastic effects of a 
given control law. Knowing the stochastic effects of the control 
u(t), the optimal control which minimizes (A2-1) can then be chosen 
from the set of admissable controls. To be admissable, the controls 
u(t) must satisfy two important properties [42] : 1. it must be 
nonanticipative, and 2. it must satisfy the Lipschitz condition to 


guarantee the existence of x(t) and_y(t) of the model 
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derived in section 2.1. The derivation of the certainty equivalence 


Property now follows. 


If, for the moment, the control vector is considered to be 


known and deterministic it is always possible to define 
x(t) = x(t) + x,(t) 
where X,(t) and x,(t) satisfy 


X(t) = A x(t) + w(t) 3 x,(t,) = x(t.) (A2-3) 


0 


Xo(t) = A x9(t) +B u(t) s x9(t,) = 0 (A2-4) 


The state X5(t) is then completely known if u(t) is known and is 


given by 


X,(t) = ® (t,t) B Ur eda. (A2-5) 


Its contribution to the observation y(t) can thus always be sub- 


tracted and one can define 


y(t) = y(t) - x5(t) = x, (t) + v(t) (A2-6) 
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where y,(t) now embodies the stochastic effects. Knowing x(t) 


then, the stochastic effects of u(t) are also known. 


Pru) 
is not known a priori the unknown contribution of u(t) cannot 

be subtracted from the observation and the stochastic effects of 
u(t) are not evident. If the control u(t) is admissable however, 
one can calculate {u(t), 1 e[t,.t]} when {y(t), 7 elt, »t]} is 
observed and then compute X5(t) in (A2-5). Hence, given x(t.) 


and monitoring {y(t), t e[t,.t]} the stochastic effects of the 


control action {u(t), 1 elt,t]} can be found. 


In the more general case, the solution of (A2-2) is 


ro o 


+f sa Wc acd sons ae at (A2-7) 


t 
Here too it can be shown that the stochastic effects of the contro] 
action {u(c)so elt,r]} can be deduced if x(t) is given. However, 


in the general case where 





Al 
Recall] that u(t) is of the form 


u(t) = oLy(t)] = ely; (t) + x5(t)]. 


Since x,(t) is known from (A2-5) then the stochastic component 
of u(t)"is also known. 
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is the observed vector, it is generally not possible to find what 
x(t) is. To circumvent this difficulty one can rather find the 
conditional stochastic effects of future control actions by treating 
the conditional density, p(x(t)/{y(c), g < t}), as one would the 
actual state x(t). The conditional density represents the 
sufficient statistic for describing the future stochastic effects. 


Therefore, it seems that a realizable control can be provided 


using [42] 
u(t) = 6(t,p(x(t)/{y(o),0 < t)) for some » (-,-) (A2-8) 


Because the conditional density: is in the function space 
which is of infinite dimension, in its present form control law 
(A2-8) is not of much practical use. Making use of the Gaussian 
assumptions of section 2.1 concerning the model (A2-2) now allow 
parametrization of the conditional density by its conditional mean 
and covariance; each in a finite dimensional space. The conditional 


mean and covariance of the state are defined by, respectively, 
x(t) g ELx(t)/y(o), o < t] (A2-9) 
s(t) g EL(x(t) - x(t))(x(t) - x(t))'/y(o), ost]. — (A2-10) 


If the covariance is independent of control and observation 


then only the conditional mean, x(t); is required to parametrize the 
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A2 


conditional density. In this case only controls of the form 


u(t) = $(ts x(t)) (A2-11) 


need be sought. The process being controlled is now the conditional 
mean process x(t). Thus, to obtain the optimal control law in this 
stochastic case, one can solve an eaten control problem where 
the conditional mean x(t) is treated as the actual state of the 
system. This is often termed the certainty equivalence property of 


optimal control. 


A2 4 
Obviously, if {y(o), o <t} is given, x(t) and x(t) can be calculated 
using equations (A2-9, A2-10) whereupon the conditional density 
is parametrized. If x(t) is not dependent on the observed vector 
{y(a), o < t} then we can calculate x(t) independently of 
{y(o), o < t} and only further seek x(t). 
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APPENDIX THREE 


THE STEADY-STATE 
KALMAN FILTER 


In appendix two it is found that, as a result of the Gaussian 
assumptions, the conditional density can be parametrized by the 
conditional mean x(t) and covariance x(t). It is a relatively 
Simple matter to show that the conditional mean defined by 


foe} 


= EVAL 0gh “I x Fy jy (She) tebe (A3-1) 


Ix > 


=0O 


is the best estimate of x(t); in the sense that x is the n-vector 


that minimizes over all n-vectors, z, the conditional expectation 
E{ | |X-2| |¢/Y=y) = EC LX-z]' LX-z]/¥=y) (A3-2) 


of the norm-squared estimation error given that Y has value y. 
The proof of this is rather straightforward and is done in a 
countless number of texts [41, 42, 45]. Expand (2-19) and 
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2 
E{ | |X-z|| /Ysy} = E{X'X-2z'X + z'2/Y=y} 


iT] 


EUR X/ Novem ez) E(X/Yayo + 2'2 


I 


EC||X||¢/Y=y} + EC | [z-ELX/Y=y]] [23 
- | JECX/Y=y3| |? 


The only term to involve y in the previous expression is the second, 


and thus minimization requires that 
z= xX = E{X/Y=y} 
The corresponding minimum of (2-19) is then 


A 2 A 
Et] [xox] |/Yayt = ECUx||2/¥=yd = 11x11? 
The conditional mean x will thus in general depend on the observed 


nm-vector y. 


For the stochastic model described by (2-3) assume that the 
initial state x(t) is Gaussian with mean and covariance given by 


E{x(t,)} = Xos cov{x(t,)» x(t,)} = Z, where the noise processes 


o) 
{w(t)}, {v(t)} are white Gaussian, with properties 
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and 
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and such that x). {w(t)},{v(t)} are independent. It is then a 
well known result that, if u(t) is admissable, the corresponding 
conditional distribution of the state is Gaussian with conditional 


mean x(t) and conditional covariance x(t) given by [ 39,42] Al 


x(t) = A x(t) + x(t) c'v"(t) (y(t) - C x(t)) 


+ Bult) 3 x(t.) = x, (A3-3) 
s(t) = A x(t) + o(t) At + w(t) - x(t) civ"! ce(t) ; 
ERS) So (A3-4) 


To obtain an estimator that is relatively easy to implement, 
it is highly desirable that the time varying nature of the filter 
defined by (A3-3, A3-4) be removed. The several assumptions made 


in connection with the stochastic model (2-3) of section 2.1 now 





Althese equations are the Kalman filter equations [22, 30] 


modified to include the effects of the deterministic input 
Wie) 
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allow us to accomplish this. Specifying the driving and observation 
noises as stationary removes the time varying nature of the auto- 


covariance matrices W(t) and V(t), whereupon (A3-3, A3-4) become 


x(t) = Ax(t) + 2(t) ci v7 (y(t) - c x(t)) 


+ Bu(t) 3 x(t.) =x, (A3-5) 
n(t) = A x(t) + c(t) Ab +W- s(t) ci v7! c x(t) ; 
sks eae (A3-6) 


Further, since the constant system (2-3) is completely controllable 


and observable, for all 
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x(t) is thus given by the steady-state Kalman filter (modified to 


include the effects of the deterministic input u(t)) 
SES) OG RG) ee Ge, (A3-8) 


The steady-state Kalman filter (A3-8) is the best linear estimator 
of the state of the completely controllable and completely observable 


constant system (2-3) in terms of the output process y(-) over the 


time interval feaga 


A2r9 emphasize the dependence of x(t), satisfying equation (2-23) 


on the initial time (t,) and the initial conditions (s,) let 


Z(t; ty»Z,) 4 x(t) 
’3For the case where the observed random vector Y and the random 
state vector X are jointly Gaussian, the conditional expectation, 
E{X/Y=y}, is linear in Y and the unconstrained least squares 
estimator then coincides with the linear least squares estimator 
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APPENDIX FOUR 
CHOOSING THE INTEGRATION ROUTINE 
AND THE INTEGRATION INTERVAL 


Several difficulties were encountered in simulating the 


system described by the state-output equations 
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Among the more serious of these : 1. that a variable step in- 
tegration routine could not be used, and 2. that the size of the 
fixed step integration interval was severely limited, were largely 
a result of the nature of the model and the simulation procedure 


employed by the CSMP program. 


System 360/CSMP generates a random number at each iteration 
cycle. Quoting the CSMP manual [20], "Structure statements 
(these specify model dynamics and associated computations) are 
translated and placed into a FORTRAN subroutine called UPDATE which 


is executed at each iteration cycle.” Then, as the integration 


Althe UPDATE subroutine also contains the CALL statements for the 


subroutine which generates the random numbers (GAUSS(-,-,:)). 
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interval is reduced, the UPDATE subroutine is executed more 
frequently and hence, per unit of machine time, more random numbers 


are generated. 


The noise cutoff frequency Le is given by 


I 1 
fo > BT) ea 


where AT is the integration interval. It thus follows that whenever 
the integration step size changes so does the noise cutoff frequency. 
As a result, variable step integration routines could not be used 

as they would cause the noise cutoff frequency to be correlated with 
the shape of the solution of the simulated differential equations. 
For the fixed-step integration routines, the integration interval 
could not be made too small or the noise cutoff frequency would be 
so high that the regulator (with a relatively narrow bandwidth) 
would effectively filter it out. On the other hand, if the fixed 
integration interval were made too large, the resulting integration 
errors could give an inaccurate solution or could swamp out effects 
which one may have hoped to observe. Some tradeoff was thus 
necessary between a desirable noise cutoff frequency and allowable 


integration errors. 


Several preliminary studies indicated that an integration step 
size of 0.01 second, F=90 Hertz, for the fourth-order Runge-Kutta 


integration routine was a reasonable choice. 
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APPENDIX FIVE 


SAMPLE COMPUTER PROGRAMS USED 
IN THIS WORK 


Some representative computer programs used in the course 
of this work are presented here for the reader's information. 
The heading of each program gives a brief description of its 


function. 
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FORTRAN IV G COMPILER (20.21) MAIN 05-30-72 15:24.49 PAGE 
c 
€ CALCULATION OF PUWER SPECTRA BY 
C AVFRAGING OVER 20 DATA RECORDS IN "7? 
C 
0001 DIMENSION 2(20460).X( 1024) eV{( 1024). 
1TAMAGN( 206512) eAMAGF(512) 
0002 READ (8.21) U 
90003 READ (8.1) 2 
0004 1 FORMAT (F10.4) 
0005 L=0 
Cc 
G GENERATION OF ZERO VALUES FOR Y-ARRAY CIMAGse PART) 
G 
0004 3 CONTINUE 
0007 DO 2 L=1,1024 
0008 Y(T)=0.0 
0009 2 CONTINUE 
€ 
Cc GENERATION OF VALUES FOR X—-ARRAY (REAL PART OF COMPLEX ND.) 
€ 
0010 N=(L#¥1024)+4) 
Oot M=(L4#1)*1024 
0012 J=L*1024 
0013 DO 4 L=NeM 
0014 K=I-J 
0015s X(K)=Z2¢019) 
0016 4 CONTINUE 
E 
Ls USE FAST FOURTER TRANSFORM ON THE TIME SERIES 
(a 
0017 LOG2N=10 
0018 IFSET=1 
0019 CALL PSSZOLA(LOG2AN6X.VYeIFSET) 
G 
g MAGNITUDE SQUARED OF THE FIRST HALF OF THE TRANSFORMED) DATA 
(€ 
0020 L=tLet 
0021 0O 7 1T=1.512 
0022 AMAGN(L 6 PI=C( KC 0) #2) +0 VOT #2) ) 
0023 7 CONTINUES 
é 
( TO PERFORM PREVIOUS CALCULATIONS FOUR 290 DATA RECORDS 
ie 
0024 K=(20-L) 
0025 IF (KeNE2O) GO TH 3 
( 
( Tl) AVERAGE OUT VALUES OHYATNED FUR TH 29 DATA RECORDS 
« 
0024 DO 9 K=12-512 
0027 ASUM=0.0 
0028 09 10 T=1-420 
0029 ASUM=ASUM¢AMAGN( Tek) 
9930 10 CONTINUE 
O31 AMAGE (K) =ASUM 


“or%.? Q CONTINUE 
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FORTRAN 


9033 
0034 
9035 


9036 
0037 
0038 
0039 
0040 
0041 

0042 
0043 


0044 
9045 
0046 
Q047 
0048 
0049 


0050 
0051 
0052 
0053 
0054 
0055 
0056 
0057 
0058 
0059 


TV G COMPILER (2061) MAIN 05-30-72? 


nD 


GY iG On Gs 


50 


00 SO [=1,.512 
AMAGF (IT )=AMAGF(E)/206 
CONTINUE 


PICK OUT MAXIMUM VALUE OF THE MAGNITUDE 


12 
1 


AMAGMX=0.0 

DO il [=1.512 

fF (CAMAGF(!I)-LT«AMAGMX) GOD TO 12 
AMAGMX=AMAGEF (I ) 

CONTINUE 

CONT INUE 

WRITE (62613) AMAGMX 
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15224.49 


SQUARED 


13 FORMAT (*—*.* MAXIMUM VALUE OF THE MAGNITUDE SQUARED®. 


TO SCALE TO MAXIMUM VALUE AND. CONVERT TO 


23 


24 


12X.E20e7) 


OO 23 1=1.512 

AMAGF (I )=AMAGF( I) /AMAGMX 
CONT TINUE 

00 24 1=1,512 


AMAGF( 1) =20-*(( ALQG(AMAGF (I I))7223026) 


CONT TINUE 


DECIBELS 


PRINT OUT SPECTRUM AND PUNCH OUT DATA CARDS 
FOR PLOTTING ROUTINE 


25 


27 
26 


199 


WRITE (6625) 


FORMAT (®-*.*SPECTRAL DENSITY IN DECIBELS*) 


0G 26 [=1+512 

WRITE (6:27) YTseAMAGF(I ) 
FORMAT (Keo LIelLOXsE2067) 
CONTINUE 

WRITE (70199) AMAGF 
FORMAT (8F104) 

STOP 

END 
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*** CONTINUOUS SYSTEM MODELING PROGRAM*# #& 
**®*PRORLEFM INPUT STATEMENTS**® 


‘ OYSTES WITH NO PLANT NOTSE AND NO MEASUREMENT NOLSE 
NO KALMAN FILTER IN FEEDBACK 


LABEL STATFE BQUATICNS 

LABEL MFASUKED STATES 

LAFEL CORRECTIVE FORCES 

INITIAL 

INCCN POI. 0, (Cle U2, I C3=07.0, O4=+2. 1,700.0 


DYNAMIC 


oi 


c'o 


Wow hla 


e e @ 
oco~osooc$cno 


tt as ert 


oa 
2 e i 
{ 


OQeWwiy a= oO & whl 
SCOCCoOMACC C!s 
e 


<<<<<xectexes 


* PLANT CYNAMICS (XDOT=AX+BU44) 
X1=-CY14DF1+wt 
DYIFRINTGRL (IC 1, x1) 
X2=LY1-DY2+¢w2 
DW1=INIGRL(IC2,X2) 
X3=-DYZ+DF2¢W3 

_ DY2=INIGRL (1C3,X 3) 
X4Y=LY2-DY3+w4 
DW2=INIGRL(IC4, Xu) 
X5=-LY3+DF34W5 
DY3=INIGRL(IC5,X5) 


CUTEUT FCUATIONS (Y=CX+V) 


Y1=Cy1+v1 
¥2=Dw1+v2 
Y3=LY2+V3 
Y4=DW2+V4 
YS=CY3+V5 


* FEEDEACK FROM CONTHCLLFR 


DF 1=- (1. 263¥*Y 142, 49U*Y 2-0, 819*7 340. 6088 VI-0, GUUFYS) 
DEZ=—{=0.8 39 *Y 1-1. 826¥Y241, 63841341. O26" YH =) 68 19K V5) 
DE 3== (-0.444*Y 1-0, 66B8*Y 2-0. 819% 13-2. 094 * YET, 2634%Y5) 


TERMINAI 


TIMER DELT=0.010 OU TDEL=0.01,FINTI*=5.0 
PRTELT LY1,DW1,LY2,0W2,DY3 
_METHOL #KSPX 
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TRIES AN Y Vege Wide Me gil Wreiodn Cas g DIE Wg iD ial 3 
PNT 
SHUG Ae 


OUTPUT VARTIADLS securNCF 


se V5 YS V4 Y4 i 3) es Wa ¥2 v1 
yl DEI x1 NE we £2 Dw wd Bite, ve 3) 
DY2 w4 Xu lw WO DF 3 X5 ae 
OUTPUT. TRPUTS EAMES SMI GS Se TART PUN IGUANA DENSI Kotte; 
32 (900) 70 (1400) BUC) ye SE ANOON) 29 (609) .) 
FAL JCB 


Ussereo ze SGteWsh MG aC 
















ft its 4 40,4 i AI gf Yo wae! a vel 


| . 0 ayant 
ry ry .¥ Ly iv ie - ; 
ie Ac ie til 4 an 
ivy oy han a. sh . 
seh ah 
AT MAA} Se OD WI © ar ee nee 2 1 
' yy ADL)! mf ‘be tn ' (ev b] 


7 ap 
fa eee Ae ae 
a : 

an@ ame : 
aaa 7 
( mi i 


4 a a 


' Dye a: ine > i 7 
7 al i 4 vu? 7 
Lamers 


ee call 4 


9 oi? ¢ ¥ H 
>. Og ae? OB ie — 7, 
r (Mee ow eee : © 


70 tS. OG «@ 
644.7604 8% 


* 


+ 


ee eCONTINUOUS SYSTEM MODELING PR OGRAM® € && 
€*€*e PROBLEM INPUT STATEMENTS #*@ 


SYSTEM WITH BOTH PLANT NOISE AND MEASURE MENT NOT 
NO KALMAN FILTER IN FEEDBACK 
NOLSE STATISTICS: w= eV=!I 


LABEL STATE EQUATIONS 
LABEL MEASURED STATES 
LABEL CORRECTIVE FORCES 


INITIAL 
INCON [C1=020+I1C2=—-42201C3=0.0s 1C4=420. 15 [C5=020 
DYNAMIC 


WIL=GAUSS( 1 e000 ele) 
W2=GAUSS( 3e0e00ele) 
@#3=GAUSS (520-200 e1-) 
W4=GAUSS(740.00¢e1-) 
WS=GAUSS(9e0200e1-) 
VL=GAUSS( 1160200 ol o) 
V2=GAUSS(13e0-00 01?) 
V 3=GAUSS (1560-0081 .) 
V4=GAUSS(17s0.-00e1-) 
VS=GAUSS( 194020001.) 


PLANT DYNAMICS (XDOT=AX+4BU +W ) 


Al=—- DY 1+DOF 14Wi 
DY 1=INTGRECICI eX!) 
X2=0V1-DYV2¢¥82 
DWL=INTGRL(1C2.xX2) 
X 3=— DY 24DF 24+W3 
DY 2=INTGRL(1C3.xX3) 
X4=DY 2-DYV 3+W4 
DW2=INTGRL(1C4.xX4) 
X5=-DY 3+ DOF 3405 
OV 3= INTGRL (1C56X5) 


GUTPUT EQUATIONS (Y=Cx#v) 


VI=OY1I+V1 
Y2=Dwl+v2 
Y3=O0Y2+V3 
Y4=0W2+Vv4 
YS=0Y3¢V5 


FEEOSACK FROM CONTRCLLER 
DF 1=—-— (C12 2638 V142 e494*V2- 00 SIDFV 340 eGOH4*YV 4-0-6 4444 V5) 
OF 2=—(—-0 eB1DFY1—-1-.826*¥Y 241 -O334V 34+ 16 B20" VY4—-02819*Y5) 
DF 3=—(—-0 0444 *Y 1-0 e668 ¥FV2—-0 eB1LO*Y 3-2 049 4#€V44) , 2O3*YS) 


TERMINAL 


TIMER DELT=0-01 »OVUTDEL=0-0LeF INT IM=5 0 
METHOD RKSFX 
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| © Fi ererantovi sovisots ices. dvs ibe toes Ibes 
END 
stop 







OUTPUT VARIABLE SEQUENCE 








en |e VSS Ve NL Thsve me TEIVSSCE . v3 _ v2 v2 v1 
v1 OF1 xt ovi w2 x2 Dwi w3 OF2 x3 
Dv2 wa x4 ow2 WS OF3 XS DY 3 
OUTPUTS INPUTS PARAMS INTEGS + MEM BLKS FORTRAN DATA CoS 
32¢500) = 7061400) = (400) = 5# =~0= «=656300) = 29 600) 8 
ENDJOB 


__ 13231219 3.439 RC=0 
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#***CONTINUOUS SYSTEM MODELING PROGRAMHS## 
***PROBLEM INPUT STATEMENTS### 


SYSTEM WITH BOTH PLANT AND MEASUREMENT NOISE 
KALMAN FILTER IN FEFODBACK  _ Asai Sy Eo ha tein eet ie Se 
NOTSE STATISTICS ARE KNOWN EXACTLY 
FILTER ASSUMES A NOISE VARIANCE OF 1.9 
ACTUAL NOISE VARIANCE IS 1.0 


te te HH 


LABEL STATE EQUATIONS 

LABEL __ MEASURED STATES ees See Se eee ; 353 = ewe 
LABEL ESTIMATED STATES 

LABEL CORRECTIVE FORCES 





INT TEAL 


INCON 101=0.0.102=-4.2.103=0e0-IC4=2.14105=0.0 | fe: 
INCON ICE1=0.04ICE2=-4624 1CE3=00091CE4=20 ly ICES=000 


DYNAMIC 


W1=GAUSS(1.0.00,1.) 

ae eG AUS SCANS Og (0) galas) ee 
W3=GAUSS(5.0.00,1. ) 
W4=GAUSS(7.0.00-1.) 
WS5=GAUSS(9-0-00e1. ) 
V1=GAUSS(11+0.0C 41.) 
V2=GAUSS(13,0.00.1.) 

VRE GAUSS (LS Oe Olle Ve) es 
V4=GAUSS(17+0.00s1.) 
V5=GAUSS(19,0.00,1.) 


* STATE EQUATIONS (XDOQT=AX+BU+W) 


PR ete PU Le ee i Be ot 
DY1=INTGRL(IC1 X21) 
X2=DY1-DY24+W2 
DWI=ENTGRLIIC2,X2) 
X3=-DV24DF2+W3 
DY2=INTGRLEEC3.X3) 
eee KG DY 2A MG eee Phe ee 2 a Soi Oe eg ee ee 
OW2=INTGRL(104—X4) 
X5=-DY3+DF34W5 
DY3=INTGRL(1C5.X5) 


* OUTPUT EQUATIONS (Y=CX+V) 
By 01 +Vi ene ted~ obdee> ve hae oierehe ek oe 
v2=0W1+V2 
Y3=DY2¢V3 
¥4=DW2+V4 
¥5=DY34V5 
FC ACMACRE TRY ERUMREOg eS see hake 
* 1. SUMBAR= SUMBAR#C TRANSPOSE *VINVERSE*Y 
SUMBR1=0.406*Y 140. 151*Y240 600 7#Y340. 008*Y4+40.001%Y5 
SUMBR2=0.151#V141.239#Y2-06143* 3-0. 102*¥4-0. 008% Y5 
_-SUMBR3=0.0007*¥ 1-05 143#Y2400400#Y34001534Y440,007#Y5 


ai 
and _ 

= 

ae 













eweewanpONs aNTJSODM MaTaNe 


SeeeTHIASTATZ THOME MAUR 
sb TOW THaNaRUBA a GHA HF wn tw Wat aks 
‘ . at + = La -<-@ tL - 
vie ‘ 9a 200 729FA iam a 
o.1 40 34AI a oo 


O.Or22i. l Raed DeOrEils 
C.9- afl of 0578371, Oe02ES3I1 +S. 


See 





160_ 


SUMBRS=0, OCOBEVI-O, LOA FY 27 #C. 14 SFV IAFL. 2 I9*YG-00. 151 * YS 
SUMBR5=0490) *Y1-9.00R8* V7 +9. OOTEV3-00 151 *V 447. 406" V5 


* ¢ eROWDOT = (A-SUMBAR#C TRANSPOSE XVINVERSE*C ) #ROW FO I 


M6=-1.406*ROW)~-02.) 51 ¥*¥ROW2-O600 TFROW3—-O 2008 *ROW4-C0 200) FKROW D+ QT 
POWL=INTGRECICE1.X6) 

KT=V.BS9EROWL = 1 229FRIW2-00 BI P#FROW AF « LO2*ROW4 HEN, ONBHR OWS +)? 
ROW2=INTGRL (ICE2sxX7) 

MX R=-90.007*ROWI 40.14 3*ROW2- 1.4 OF ROW 3-10 14 3* ROWSE UY THROWS HOS 
ROWS=INTGRL(ICFE3.X8) 

X9=-Q.O0CR*ROW1L +0. 102* ROW? +0 a P5 7 ¥ROW 3-12 239*ROW4S—O 0 B49 *R UW 5404 
ROWG=INTGRULCICE4+X9) 

KX10=-0 001 *¥RNW14+9. OCB*ROW2-0.007#ROW 3406 LS LXROW4S— 1640 5FRIWSHQ5S 
ROWS=INTGRL(ICF5.x10) 


+ 4eGI=GAMMA=O0UTPUT OF FILTER 


G1=ROW1] 
G2=ROW2 
G3=ROW3 
G4=ROW4 
G5=ROW5 


= 4.R*U(TY=-B*¥LSTAR*GT (WHERE UL=DF1L,U3=NF2,U5=0F 3) 


DF 1=-(16263¥*G6142 6.494% 62-0. 819*G34+0.668*64-0.444*G65) 
DF 2=-(-0.819*G1-1. 826*G241.638*6341 6 326*64-0.4519*65) 
DF3=-(-0.444*G61-0.668¥*G62-0 49 819% 3-70 494*G441 6 263*65) 


* © ,O1=SUMBAR+BRU(T) 


01=SUMBR1+DFi 
O2=SUMBR2 
03=SUMBP3+0DF2 
04=SUMBR4 
05=SUMBR5+4DF 3 


TERMINAL 


TIMER DEL T=O-0LOUTDEL=0.01L eFINTIM=5.0 

METHOD RKSFX 

PRTPLT DY1 .OW1 ,CY2,0W2,DY3 

PREPAR DY¥1eDW1 se DY2 ,DW2eDV 3 eV a Vee Ve V4 V0 G1 G2 G3 Hy G49 O55 nae 
O0F1.0F2.,0F3 


END 
STNP 
AUTH IT VAPTARLE SEQUENCE 
wi G5 G4 G3 G2 Gl OF 1 x1 ada We 
Kx? Dl} W3 OF 2 X3 DY2 W4 x4 Nw W5 
NF X K5 03 V5 v5 V4 Y4 V3 Vea V2 
v? vi y) SUMBR1 Ql X6 ROW) SUMBR2 92 X7 
ROWS SUMBES 03 x8 RIW3 SUMBR4& 94 x9 ROW4 SUMSR5 
nS WV ROWS 
AYTIANTS INPUTS PARAMS INTEGS + MEM BLKS FCRTRAN QOATA CLS 


GT550) Y4H(1 4690) 13400) 10+ = 10(309) 54(600) LZ 
















at a 


Pere body Weiser tah Na bah iN bg to 
OWT ORE VELL PvE TAD ie eM Re ER 


[OeWOe | 84> waVbr Me pane 
Ie WONO) on. o- AHO AGL. O- FxDAOY UhedotwORee td 

















‘, 
® Fr y 
CU ere mene 4 ew naan ot th WMO TA OO , s - 
oe ®. ri 
DHOHO TET ON, HAW ISRE A6 .1)- POD DAL F-oe 4 a 
4 ‘ 
Sec HUAEO Oh, U-AWORBCES , (-~F nn) 29, 0e0N0 t 7 : 
PD IFHUMe OT LOW Oe! 2] 040 Nrne tv OO. b= Swen 7 
s 4 
(#307), S29=F, s4te Mi) Sew 
(FDMMES NAD LOA CFE IME (8. 0-S98802, Ta 7 


(A2OP LE. 9 Heate. Leeneer ssl eX aeases I+ 
AIMEE AS of 4e 9865.5 ~F jC TB.0-SieGaad.0- ! 


4 





2 =4ETV IAL 10atey WOTAhe BOat 


EY, EWO,SYGs f 
Pde edly f= JeSaedeiege tert, FV SV el Ve Pei at et MF 


*ere 


s6 pyre 1x 
aw tac ax 
SV po BY ay. 
ve 94 


Serviye 


161 


****CONTENUOUS SYSTEM MODELING PROGRAM#SE® 


***PROBLEM INPUT STATEMENTS& 9% 


ae 








* 


e 


SYSTEM WITH PLANT NOTSE ONLY 


MEASUREMENT OF SYSTEM STATES EXACT: BUT WITH TIME DELAY. 
NO PREDICTOR IN FEEDBACK 
DELAY TIME=P=0.1 SECOND 


LABEL STATE EQUATIONS 
LABEL MEASURED STATES 
LABEL CORRECTIVE FORCES _ 


INITIAL 
INCON 1C1=000¢ 1C2=—-4042,41C3=0 006 1C4=#26141C5=0-0 


DYNAMIC 
WI=GAUSS(1.0e00,1.) 
W2=GAUSS(3e0-00e1e) 
WI=GAUSS(5.0.00,1 6) 
W&=GAUSS(7.0.00.1-) 
WS=GAUSS(920.00.1e) — 





PLANT DYNAMICS (xXDOT=Ax+BUeW) 


X1L=-DY1+4DF 1 ¢W1 
DV1=INTGRLCIC1»X1) 
X2=DV1-DY2¢w2 


OWL=INTGRL(IC2,x2) 
X3Z=-DV2¢4¢0F2+4+03 
DY2=INTGRL(I1CI,Xx3) 
X4=O0Y2-DV3+W4 
DW2=INTGRL (1C45Xx4) 





OUTPUT EQUATIONS (Y=CX(T-P)) 


VI=DELAV(9s001¢DY1) 
Y2=0ELAY(9+0-1,Dw1) 





x 


Y3=DEL AY(9.0.1+DY2) 
V4=DELAYV(920.1.0W2) 
YS=DEL AY(99001 »DY3) 


FEEOBACK FROM CCNTROLLER 


OF 1=—( 16 263*Y142.494#Y2-0.8194%Y 340. 668% Y4—-0.444#Y5) | 
DF 2=-(—0.819*V1-1 68268 Y241.6 38% 341 «826% 4—020819*YS) 
DF 3=-(-0.4444Y1-0.668*V2-0.8 19*Y 3-2 64944 Y441.263KY5) 


TERMINAL 


TIMER DELT=0.01.QUTDEL=0.01 sFENTIM=5~0 
METHOD RKSFX 

PREPAR OV! OWL sDV2 eOW2 DVS eV 1 eo V20V3eVSe0Y5e0DEl oDF2,0F3 
END 

stop 
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OUTPUT VARIABLE SEQUENCE 


wi Ys v4 Y3 y2 vl DF i x1 Ovi We 
x2 Owl w3 OF2 x3 OY¥2 wa Ka Ow2 WS 
OF3 x5 Dv 3 
OBuTPuUTS - INPUTS PARAMS _INTEGS + MEM BLKS FORTRAN OATA CDS. 
27(500) 65(1400) 8(400) 5+ 5= 10(300) 24(600) 8 
END JOB 


12211.06 346425 RC=0 
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FORTRAN TV G COMPILER (2061) MAIN ORS 2 Orie 13:3%.46 PAGE 


[ 
| Cc 
C TO CALCULATE EXPCAT) WHERE 
L C *A* IS A MATRIX AND "T* IS A CONSTANT 
c 
3 oot DIMENSLON AC5¢5) 060555) R0565) 0510505) 6 S205 05) 6 
15931505) sADD1 (505) 





| Cc 
| Cc READ IN VALUES FOR *A*,*1* 3 CHECK FOR CIRRECTNESS 
G 
oc 02 READ (50105) ((ACIT oJ) oe J=1 05) of =1 55) 
vc a3 READ (5.105) ((GCT ed) eJ=125) .1=145) 
90 04 105 FORMAT (5F10.45) 
9005 WRITE (6.100) 
| OC 06 100 FORMAT (*—-*,*A( iow) IS*) 
' oc 07 WRITE (65106) (CACTI) oe J=1 05) 0 L=105) 
oc 08 WRITE (65101) 
00 09 101 FORMAT (*=",°L (Tey) IS") 
0010 WRETE (69108) ((GCTe J) oo J=l 05) 07T=1-5) 
OoO1L 106 FORMAT (10Xe5F1063) 
00 l2 108 FORMAT €10Xe5F10-3) 
G 
Cc SET QRDER OF EXPANSION; SET DELAY TIME 
Cc 
0013 N=16 
0014 T=0-40 
0015 DO 20 K=194 
90 16 T=T+0.01 
mis Cc Af eh ee ae 
o017 WRITE (65300) T 
0018 300 FORMAT (1X0o®T IS%e IX sF4e2) 
Cc 
Cc CALCULATE SUCCESSIVE TERMS OF THE EXPANSION 
Cc 
0019 : CALL SMPY(AsTsRoSe 5s 0) 
0020 CALL MCPY(ReS1 250520) 
0021 CALL MCPYCS1 1S2e5025-0) 
0022 CALL GMADD(GeS1 eRe 505) 
00 23 CALL MCPY (Re ADDI 250550) 
0024 00 19 L=2eNn 
9025 _ <P ae CALL SMPYCSi ste/LeoRe50550) 
00 26 CALL MCPY(ReS3 250500) 
0027 CALL MPRDO(532S20Re5050 00 00 S) 
0028 CALL MCPY@(Rs,S2959520) 
Cc 
0029 WRITE (64200) L 
0030 ___ 200 FORMAT (*—*,15Xe*TERM *.12) 
0031 WRITE (62201) (S201 oJ) op J=105) 01 =125) 
0032 201 FORMAT (22Xs 5F106e5) 
c 
Cc ADO EACH SUCCESSIVE TERM TO PARTIAL SUM 
Cc 
_.0033 ; _ CALL GMADD(A0D12S20R+5e5) 
00 34 CALL MCPY (Re ADDI 050500) 
Cc 


0035 WRITE (6,152) 
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( FIRTRAN LV G COMPILER (20.1) MAIN 05-26-72 13236246 PAGE 
00 36 152 FORMAT (*-*,15Xe"EXPCAT) ES*) 
0037 WRITE (66203) (CADDI Che Jd oe J=beS) o1=105) 
0038 203 FORMAT (22Xs5F 1065) 

. 0039. =. —=———s—s—~<—isé‘«x CNT ENE 

| 00 40 20 CONTINUE 

| 0041 END 
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*eEECUNTINUOUS SYSTEM MODELING PROGRAMMERS & 
#*ePROBLEM INPUT STATEMENTS # 8% 


* SYSTFM WITH PLANT NOISE ONLY 

* MEASUREMENT OF SYSTEM STATES EXACT; BUT WETH TIME DELAY 
* PREDECTOR ONLY IN FFEDBACK 

® OLLAY TIME=P=001 SFC. 


LABEL STATE EQUATIONS 
LABEL MEASURED STATES 
LAGEL PREDICTED STATES 
LABEL CORRECTIVE FORCES 


INITIAL 


INCON Ic1=0-0,1C2=-4e-2,1C3=0-0,1C4=2 fe ole = 10) 6) 

INCGN ICD1=000 9 [CD2=—4 024 1C03=0 004 ICN4=2 01 e ICIS=000 
PARAMETER EX11=0 09049, EX12=0 00s EX1 3=U 0 Dot KIG=0 OVE XTS=N On eee 
EX21= 0.0952 ¢EX22=1 6 Oe X 23=- 000952 oF K24=000 el X25=0 0p eee 
EX31=0 00s EX32=0 60 sFX33=069048 sFX34=00 00k X35=0 00s, eee 

EX41=DNe Os F X42=0 40 cE X43=0 ec INGH7GEKG4G=A1 OG EX49=-DNeD ID gp eee 
EX51=0 006 EX52=0 00 EX5 3=0 0 0 EX54=0 00 at X55500 2048 





aga ae Oh Soe : 


' 
DYNAMIC 
WI=GAUSS(1+60-¢00+1-e) 
W2=GAUSS(3+e0e¢00e1.e) 
W3=GAUSS(5.02090 61.) 
_W4=GAUSS( 740200416) 
| 





WS=GAUSS(9,0-000el14) 
* STATE EQUATIONS (XDOT=AX+AUI4+ Ww ) 


X1=-DY1+0F14+W1 
DYL=INTGRLCIC1,X%1) 
X2=DV1-DY24W2 
DWI=INTGRLCIC2 5x2) 
X3=-DY24DF2+4W3 

DY 2=INTGPLCIC34X3) 
X4=DY2-DY3+W4 
Dw2sINTGRLCIC&s Ka) 


X5=-DY 34D 34W5 
DY3=INTGRE( ICS, X5) 


* OUTPUT EQUATIONS (Y=CxX(I-P)) 


YL=DELAY(9,001,0Y1) 
~YV2=DELAY(9+001,0W1) 
VY 3=DELAY(9,001,DY2) 
Y4=DELAY(9.001,DW2) 
YS=DFLAY (99001. MY 3) 


* LEAST MEAN-SQUARED PREDICTOR 
* LeOETERMINISTIC PART OF PLANT MODEL 


KILL=-Z1+DF 1 
ZI=INTGREL(ICO1. X11) 
XL2=21-23 

Z2=INTGRLE (1ICDOe+ X12) 


5 
= 
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sansa HI VINO ROT Iaa4e r 

»3 42 .O>90 9M1T vas $4) 


7 wf 
emi TAVOS WATE ‘Sten re. 
2itate they Jae@al 7 1 
earate o Bt2 taxa AIA 4 
eee ovat alia: AIGA J : 
‘ee = : 
PATTI 
, 
LOPE DE + Pe SEH MG He Oal Ply h ote whI) 6 Oe vast vorw) 
Oe FP UF e be S= ODT pHe0 =COD), Seth" SO) 70 0» 14. 05M 1 ; mm 
ots K eG. 0 8B 1¥ 40 Oe OSE EK Be Oe OHS 18 9. CROUL On 1 INS O47 Wan as 7 
cee eo She Hay GE 160.0 BAK 44520080 —SESR WO i Tas SK14 SAPO 4 DA1SH 
». O CRY, Oe DS AEWA, MEO -OSETA 146e O85 ERS spOeGr tt a3 . A 
eee + wi sre) RAs bh? 15HO0. CELEXA, CoO GARD Data hex 4 _ 
msoo CA “> V6 0a 1-0 - 0a eKS. Os OSSONEs @.0-1ex5 : ; 
‘ai i ch in , 
Deano ; a 
> J 
1a lene (JABUAO~ 18 
(+ bia Ona RP Ss? 
(4 le OOeD, @PZ2UA0=1 6 - 
Seb eOOrOe¥ IRAUAD=2 & 
(+ fe 006050 1020 iAD-=oe ; ‘ 
(a+GeMA=TOGR) QWDITAUOS State = 6 
f twe Laaetya==4% : 
(1X, £92 a8 thie IYO OF 
awesvoury (igh 
(Se. SOL Pata Oo — 
Kile Sie ow sek Wi 
(Ex UID) PML esye “1 


Hw eh YO=SOe ox 

(Oh D0) 19OP ete 
Pwek aC)Ot Ye at 

ire uM sy seve ii 


(49-4 eer owas va 


RY 


aS Ov 4 att 


K13=-ZA4D0F 2 


Z23=INTGRLCICO4.X1 4) 


M1L4=73-75 


Z4=INTGRELCICO4, X14) 


X15=-Z5+0F 3 


Z5=INTGRL (10056 X15) 


* 2eVELAY OF DETERMINISTIC MODEL STATES 


YUL=DELAY(95001 621) 
YU2=DELAY( 9.061.227) 
YU3=DELAY(9 5001423) 
YUS=DEL AY (96001424) 


YUS=DELAY(9, 


Ne1lwZ5) 


* 3oeR(TI=AV(TI-YUCT) 


SIL=Y1-YuUl | 


ST2=Y2-YU2 
SI13=V3-YUS 
SIT4=Y4-YU4 
SIS5S=Y5-YUS 


# 4s EXR=EXP(APDER(T) 


EXRI=EXIDI*SIIFE XI 2*SI 246 KISS] SHE X1GRST4HE KIS#SIS 
EXR2=EX21*STIFEX22*ST 2+E XK? BRST SHE X24*SL44E X258S15 
EXR Z=EX31*STIFE X32*ST 2+EX33KST IFEX S4*ST44EX35*S15 
EXRG=EXO1LESTLFE XS 2HST24E XG3HSI 34EX4 48ST 44E X45*S15 

JEXRS=EXSILFSTIUFEXS2HSISAEXS SSSI SFE XS4 AS TA+EXS5S*SI5 


a SeXHAT(TI=EXR+Z 


OL=EXR14Z1 
D2=EXR2+22 
D3=EXR3+Z3 
D4=EXR44z74_ 
DS=EXR5+Z5 


* USTAR(T )=-LSTAR®XHAT(T) 


_DF 1=- (16 263*01426494*D2-02819*D 340. 668 €14—- 00 444%05) 
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DF 2=-(-04819*D 1-1 -826*0241 4.6 38*D34+1 .826*D4-02519%D5 ) 
DF 3=-(-02444#D1—-0 e 668* 02-0 6 819 *D 3-2 e494 *D441 ect 3*05) 


TERMINAL 


_ TIMER DELT=0¢01 0eGUTDEL=0-e01,FINTIM=5.0 





METHOD RKSFX 


PREPAR DY1 .DW1IeDY2 sOW2eDY3e Vis VY2AeV Se V4 oe Y5e IL si2eD3eD4sDN5veocoe 


OF 1.0F2,.DF3 
END 
STOP 


VARIABLE SEQUENCE 


SIs Sta S13 
O03 EXR2 02 
ve yu v1 
Owt w3 OF2 


+ ee) 


st2 
yus 
EXRI 
x3 
Zz. 





SIf €XRS bs EXR4G 
YS Yu4 Y4 YU3 
D1 DF1 a DY1 
DY2 w4 xa Dw2 
x12 ri Poo ee ata feat in 


D4 
¥3 
Wo 
WS 


x14 
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74 x15 “4 
OUTPUTS INPUTS 
57(500) 146001400) 


TOTO. 1TA 


Is 


END JOR 


Geta 2E=0 


PARAMS 
38(400) 


INTEGS + MEM BLKS 
10# 10= 20(300) 


FORTRAN 
54(600) 


DATA COS 
16 
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eeEHCONTENUIIUS SYSTEM MODEL ING PROG AMO tee 


eeEPHORL EM TNPUT STATEMENT See 


. SYSTEM WITH DOLANT NOTSE «MP ASUREMENT NOISE. AND) FEEORACK TEME OF LAY 
* POSTTION DOE VEATIONS ALONE TNCUR A COST 
* TEME DELAY=0.$ SEC. NUTSE VARTANCE =1.0- 

LASEL STATE UQUATIONS 

LABEL MEASUPED STATES 

LABEL FSOTIMATEN STATES 

LABE! PREDICTED STATES 


LABEL CORRECTIVE FORCES 
INETTAL 
UNCON [CU=0.0. [C2=060e1C3=000s 1 C4200 Oe TO. 


UNCON 1CE1=0.0,1TCE2Z=0. 05 1CE3=0.0,I1CE4=0 60.1 CES=0.0 
INCON TCOL=0.0>% [TH2=0 205 ITH3=0 0. 1CN4=0.0. 1 CDA=0.8 


PARAMETER EXLl=00e74 0B EX12Z=0 0) oEXI 3=060et XVA=D ee Oe X1S= Oe Nee ve 


f£X21=0 ce 25GP et X22=1 eo ON 00 oF KZ 3-0 02592 sE KEG =0e De EX 5EN eg eee 
EX3L1=0420.8X37=0.0,Fx I3=O°eTHAOBLEXKS4=Ue Veh MI5=De Ove we 

EX41= 06068 X47=0 00 sEX43=0 oe 2P592 cE K4A=1 POOND GI K45E—-5 we 25RD ge oe 
CX51L= Oe F X52=0 Me EXSI=0 0 OeF XRA=Oe Ost X55=0-740R 


DYNAMIC 


WI=GAUSS (1.0 .091003 
W2=GAUSS( 350 600100) 
W3=GAUSS( 540 005100} 
WA=GAUSSU7 20 s0, te 0) 
WS=GAUSS( 990604100) 
VI=GAUSS( 11 60s091-0) 
V2=GAUSS(1340 206160) 
V3=GAUS5(15504«0,160) 
V4=GAUSS( 1720250160) 
VS5=GAUSS(19,0.6«e1e0) 


> STATE EQUATIONS (XDOT=AX45U+W) 


X1L=-DY1#DF 1 +W1 
OVI=INTGRLCICIt.X1) 
~ X2=DYI=D0V2+Wo 
DWIL=INTGRL(1C26X2) 

X3=-DY24+DF24W3 
DY2=ENTGPLCIC3+x3) 
X4=DV2-DY34+W4 
DW2=INTGFL(IC4 4X4) 
X5=-DV3+DF 3405 

DY 3=IENTGRL (1C5sx5) 


* CORRUPTION OF PLANT STATES ffY NOTSE 


VZ1I=DV1+V1 

Sey 2 aAHDWL Se Vic me are 
¥Z3=DOVY24*V3 
YZ4=DW?4+V4 
YZS=DY34+V5 


* DELAY OF CORRUPTED PLANT STATES 
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VEHUEL AVC PDA. 4eV21) 
VZ=NELAV (2% e006 36V72) 
VPM AY CV Oe Ve¥2 2) 
VAR VEL AVI 260e 4eVC4) 
VYS=OLLAYV O29 6023625) 


* KALMAN FTL TEP 
e Te SUMBAR = SUMBAREC TRANSPOSE €VINVERSE*Y ~ 


SUMRVPE=O.,O06*YL4EOeL! HVevP+Oe.O07KY 340. ONBEY44*0 6.0018 Y'5 
SUIMHRE-O.ISVEVYITL FAL. 2349 YO- Ne LAS*EV3I-GQLLOZKY4A-OCDOREYS 
SUMARI=OO07KYI-OelLAIFYP 40, QOO*Y 340 -1L44*Y440.0078YS5 
SUMAEG= 0. 00RRKY I-01 O28 Y 240. 14 3*YS41 2 I9KYA-O61 51 YS 
SUMARH=OSIOLFYI—-OcO08KY2 tO .007KYI—-O otk OLEVY4AIOCA0HKYS 


“ 2 eA#FUCT-P)=-BEL STARE xP (-SP) 


DF ID=DELAY(29.063.DF1) 
DEZD=DELAYC29.0.3.0F2) © 
DF SD=DELAY (29 400%3,DF3) 


+ 3eQT=SUMBAR+B*U(T-P) 


QL=SUMBRP1L4EDF ID 

~ O2=SUMARD ~ bx 
Q3=SUMBR34DF 20 
Q4=SUMBR4 
QO5=SUMBRS 4DF 30D 


* 4 eROWDOT= (A= SUMBAR#C TRANSPOSE *VINVERS SESCUFRUWHQT 


X6=-1 e406#ROW1-06151*ROW2—-0 e007 *ROW3—0 OOK SHKIW4—0. 001*RUWS+4+Q1 
ROWL=INTGRULCICE1,»X6) 

K7=0-.849#ROWL-—1-2-239*ROW2-0-. 857*ROWS +40 © L02%R20 W440. 008*ROWS4+02 
ROW2=INTGRL( ICE? x7) 

X8=— 02007 #RUW1 +0 01434911W2—1 6400 ROW 3— 0214 3#RU WG-06 007#ROWS 403 
~ ROWS=INTGRUTICES, XA) - 

X9=-O-e ONH*EROW1404.102*ROWL +0 2 857% ROW 3-1 e239 *P 0 W4—0 ee 849% RO0W5404 
ROW4=INTGRL (ICE4. x9) 

X10=-—90-001* ROW! 40 .008*RUW?2—0 2007 *€ROW3400151 *RUW4—-1 o 406*ROW5405 
ROWS=INTGRLL ICES, x10) 


5 eGT=GAMMA=OUTPUT OF FILTER 


Gt=ROW1 
G2=ROW2 
G3=ROW3 
G4=ROW4 
©) ScS=RONS= | 


* LEAST MEAN-SQUARED PREDICTOR 
* L.DETERMINISTIC PAST OF PLANT MODEL 


X1L1=-Z1+0F 1 
ee er er eZ I= INNGRi feb hex ltd 

Mi2=21-23 

Z2=INTGRLE (I1CO2,x12) 

MI 3=-Z34DF2 

Z3=INTGRL (1C03,X13) 

X14=2Z3-2Z5 
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